You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/01/20 04:30:45 UTC
[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.7.0) - Build # 1214 -
Still Failing!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/1214/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
1 tests failed.
REGRESSION: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testDistribSearch
Error Message:
Still found collection that should be gone
Stack Trace:
java.lang.AssertionError: Still found collection that should be gone
at __randomizedtesting.SeedInfo.seed([69F698A549277620:E81016BD3E78161C]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertFalse(Assert.java:68)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.deleteCollectionWithDownNodes(CollectionsAPIDistributedZkTest.java:395)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.doTest(CollectionsAPIDistributedZkTest.java:203)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 9904 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> 140517 T333 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /qv/j
[junit4] 2> 140530 T333 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-CollectionsAPIDistributedZkTest-1390185489656
[junit4] 2> 140536 T333 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 140537 T334 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 140639 T333 oasc.ZkTestServer.run start zk server on port:52503
[junit4] 2> 140641 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 140649 T340 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d87b6ba name:ZooKeeperConnection Watcher:127.0.0.1:52503 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 140649 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 140650 T333 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 140669 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 140683 T342 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d61d293 name:ZooKeeperConnection Watcher:127.0.0.1:52503/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 140684 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 140684 T333 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 140693 T333 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 140703 T333 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 140711 T333 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 140724 T333 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 140729 T333 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 140753 T333 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 140754 T333 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 140763 T333 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 140764 T333 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 140778 T333 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 140779 T333 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 140797 T333 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 140798 T333 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 140805 T333 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 140806 T333 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 140815 T333 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 140815 T333 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 140826 T333 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 140826 T333 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 140837 T333 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 140838 T333 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 140847 T333 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 140848 T333 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 140861 T333 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 140862 T333 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> Using old style solr.xml
[junit4] 2> 141250 T333 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 141260 T333 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52506
[junit4] 2> 141261 T333 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 141261 T333 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 141261 T333 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997
[junit4] 2> 141262 T333 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/'
[junit4] 2> 141300 T333 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/solr.xml
[junit4] 2> 141398 T333 oasc.CoreContainer.<init> New CoreContainer 2090188601
[junit4] 2> 141399 T333 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/]
[junit4] 2> 141402 T333 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 141403 T333 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 141404 T333 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 141405 T333 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 141406 T333 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 141407 T333 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 141407 T333 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 141408 T333 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 141408 T333 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 141424 T333 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 141425 T333 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 141425 T333 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 141426 T333 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52503/solr
[junit4] 2> 141427 T333 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 141429 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 141434 T353 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@30552a4a name:ZooKeeperConnection Watcher:127.0.0.1:52503 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 141435 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 141444 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 141449 T355 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@22922e62 name:ZooKeeperConnection Watcher:127.0.0.1:52503/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 141450 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 141455 T333 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 141468 T333 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 141478 T333 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 141485 T333 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52506_qv%2Fj
[junit4] 2> 141488 T333 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52506_qv%2Fj
[junit4] 2> 141503 T333 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 141512 T333 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 141529 T333 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 141539 T333 oasc.Overseer.start Overseer (id=91107196250619907-127.0.0.1:52506_qv%2Fj-n_0000000000) starting
[junit4] 2> 141556 T333 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 141578 T357 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 141583 T357 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 141584 T333 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 141599 T333 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 141603 T333 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 141616 T356 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 141619 T333 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 141619 T333 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 141622 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 141628 T360 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@20a77c78 name:ZooKeeperConnection Watcher:127.0.0.1:52503/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 141628 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 141633 T333 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 141644 T333 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 142035 T333 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 142042 T333 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52510
[junit4] 2> 142044 T333 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 142045 T333 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 142045 T333 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765
[junit4] 2> 142045 T333 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/'
[junit4] 2> 142079 T333 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/solr.xml
[junit4] 2> 142184 T333 oasc.CoreContainer.<init> New CoreContainer 1960370870
[junit4] 2> 142184 T333 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/]
[junit4] 2> 142186 T333 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 142186 T333 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 142187 T333 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 142187 T333 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 142190 T333 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 142190 T333 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 142190 T333 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 142191 T333 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 142191 T333 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 142204 T333 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 142205 T333 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 142205 T333 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 142205 T333 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52503/solr
[junit4] 2> 142206 T333 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 142207 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 142212 T371 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4b0c56a8 name:ZooKeeperConnection Watcher:127.0.0.1:52503 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 142213 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 142221 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 142225 T373 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@25d6536d name:ZooKeeperConnection Watcher:127.0.0.1:52503/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 142225 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 142237 T333 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 143254 T333 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52510_qv%2Fj
[junit4] 2> 143260 T333 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52510_qv%2Fj
[junit4] 2> 143277 T355 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 143278 T360 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 143277 T373 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 143301 T333 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 143302 T333 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 143704 T333 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 143712 T333 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52513
[junit4] 2> 143714 T333 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 143715 T333 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 143715 T333 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390185492423
[junit4] 2> 143716 T333 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390185492423/'
[junit4] 2> 143755 T333 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390185492423/solr.xml
[junit4] 2> 143861 T333 oasc.CoreContainer.<init> New CoreContainer 534058091
[junit4] 2> 143861 T333 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty2-1390185492423/]
[junit4] 2> 143864 T333 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 143864 T333 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 143864 T333 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 143865 T333 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 143865 T333 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 143865 T333 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 143866 T333 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 143866 T333 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 143866 T333 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 143878 T333 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 143879 T333 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 143879 T333 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 143880 T333 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52503/solr
[junit4] 2> 143880 T333 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 143882 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 143886 T385 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5e2f8d20 name:ZooKeeperConnection Watcher:127.0.0.1:52503 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 143887 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 143892 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 143897 T387 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@330ad7eb name:ZooKeeperConnection Watcher:127.0.0.1:52503/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 143898 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 143910 T333 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 144922 T333 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52513_qv%2Fj
[junit4] 2> 144927 T333 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52513_qv%2Fj
[junit4] 2> 144947 T360 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 144948 T387 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 144948 T355 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 144948 T373 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 144982 T333 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 144982 T333 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 145327 T333 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 145332 T333 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52516
[junit4] 2> 145334 T333 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 145335 T333 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 145335 T333 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103
[junit4] 2> 145335 T333 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/'
[junit4] 2> 145364 T333 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/solr.xml
[junit4] 2> 145475 T333 oasc.CoreContainer.<init> New CoreContainer 416827393
[junit4] 2> 145476 T333 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/]
[junit4] 2> 145478 T333 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 145479 T333 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 145479 T333 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 145479 T333 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 145480 T333 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 145480 T333 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 145481 T333 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 145481 T333 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 145482 T333 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 145493 T333 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 145494 T333 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 145495 T333 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 145496 T333 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52503/solr
[junit4] 2> 145496 T333 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 145498 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 145503 T399 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5f4665 name:ZooKeeperConnection Watcher:127.0.0.1:52503 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 145504 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 145512 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 145517 T401 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@15c886f3 name:ZooKeeperConnection Watcher:127.0.0.1:52503/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 145518 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 145531 T333 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 146541 T333 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52516_qv%2Fj
[junit4] 2> 146544 T333 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52516_qv%2Fj
[junit4] 2> 146554 T355 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 146555 T360 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 146556 T401 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 146557 T387 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 146557 T373 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 146573 T333 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 146573 T333 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 146968 T333 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 146973 T333 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52519
[junit4] 2> 146974 T333 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 146975 T333 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 146975 T333 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694
[junit4] 2> 146975 T333 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/'
[junit4] 2> 147007 T333 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/solr.xml
[junit4] 2> 147153 T333 oasc.CoreContainer.<init> New CoreContainer 991777807
[junit4] 2> 147154 T333 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/]
[junit4] 2> 147157 T333 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 120000
[junit4] 2> 147158 T333 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 147158 T333 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 147159 T333 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 147160 T333 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 147160 T333 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 147161 T333 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 147161 T333 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 147162 T333 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 147187 T333 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 147187 T333 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 147188 T333 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 147189 T333 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52503/solr
[junit4] 2> 147190 T333 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 147192 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 147198 T413 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@279c31b name:ZooKeeperConnection Watcher:127.0.0.1:52503 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 147199 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 147210 T333 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 147215 T415 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@32487a99 name:ZooKeeperConnection Watcher:127.0.0.1:52503/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 147216 T333 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 147230 T333 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 148241 T333 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52519_qv%2Fj
[junit4] 2> 148244 T333 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52519_qv%2Fj
[junit4] 2> 148256 T373 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 148258 T355 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 148260 T401 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 148261 T387 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 148261 T360 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 148262 T415 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 148280 T333 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 148281 T333 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 148294 T367 oasha.CollectionsHandler.handleCreateAction Creating Collection : name=solrj_collection&wt=javabin&replicationFactor=2&router.field=myOwnField&numShards=2&version=2&action=CREATE&collection.configName=conf1&router.name=compositeId
[junit4] 2> 148298 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 148304 T357 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 148305 T357 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"solrj_collection",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "collection.configName":"conf1",
[junit4] 2> "numShards":"2",
[junit4] 2> "router.field":"myOwnField",
[junit4] 2> "router.name":"compositeId"}
[junit4] 2> 148306 T357 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/solrj_collection
[junit4] 2> 148306 T357 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection
[junit4] 2> 148322 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 148329 T356 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 148332 T356 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: solrj_collection
[junit4] 2> 148332 T356 oasc.Overseer$ClusterStateUpdater.createCollection Create collection solrj_collection with shards [shard1, shard2]
[junit4] 2> 148350 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 148353 T355 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 148354 T387 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 148355 T360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 148354 T415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 148355 T401 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 148356 T373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 148425 T357 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2] , repFactor : 2
[junit4] 2> 148425 T357 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica1 as part of slice shard1 of collection solrj_collection on 127.0.0.1:52519_qv%2Fj
[junit4] 2> 148427 T357 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard1_replica2 as part of slice shard1 of collection solrj_collection on 127.0.0.1:52506_qv%2Fj
[junit4] 2> 148428 T357 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica1 as part of slice shard2 of collection solrj_collection on 127.0.0.1:52510_qv%2Fj
[junit4] 2> 148433 T357 oasc.OverseerCollectionProcessor.createCollection Creating shard solrj_collection_shard2_replica2 as part of slice shard2 of collection solrj_collection on 127.0.0.1:52516_qv%2Fj
[junit4] 2> 148440 T351 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica2 state=down
[junit4] 2> 148441 T409 oasc.ZkController.publish publishing core=solrj_collection_shard1_replica1 state=down
[junit4] 2> 148446 T368 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica1 state=down
[junit4] 2> 148448 T393 oasc.ZkController.publish publishing core=solrj_collection_shard2_replica2 state=down
[junit4] 2> 148450 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 148451 T351 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 148454 T409 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 148456 T393 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 148458 T368 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 148462 T356 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 148464 T356 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52506/qv/j",
[junit4] 2> "core":"solrj_collection_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52506_qv%2Fj",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 148473 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 148476 T356 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52519/qv/j",
[junit4] 2> "core":"solrj_collection_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52519_qv%2Fj",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 148486 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 148489 T356 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52516/qv/j",
[junit4] 2> "core":"solrj_collection_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52516_qv%2Fj",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 148497 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 148501 T356 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52510/qv/j",
[junit4] 2> "core":"solrj_collection_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52510_qv%2Fj",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"solrj_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 148511 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 148620 T415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 148620 T355 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 148621 T401 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 148620 T360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 148621 T387 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 148621 T373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 149453 T351 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica2
[junit4] 2> 149456 T409 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard1_replica1
[junit4] 2> 149457 T351 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/solr.xml
[junit4] 2> 149461 T368 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica1
[junit4] 2> 149459 T393 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for solrj_collection_shard2_replica2
[junit4] 2> 149463 T368 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/solr.xml
[junit4] 2> 149463 T393 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/solr.xml
[junit4] 2> 149464 T393 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica2' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/solrj_collection_shard2_replica2
[junit4] 2> 149464 T393 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 149459 T409 oasc.SolrXMLCoresLocator.doPersist Persisted core descriptions to /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/solr.xml
[junit4] 2> 149466 T409 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica1' using instanceDir: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/solrj_collection_shard1_replica1
[junit4] 2> 149467 T409 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 149461 T351 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard1_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/solrj_collection_shard1_replica2
[junit4] 2> 149468 T351 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 149468 T393 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 149470 T393 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 149464 T368 oasc.CoreContainer.create Creating SolrCore 'solrj_collection_shard2_replica1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/solrj_collection_shard2_replica1
[junit4] 2> 149471 T368 oasc.ZkController.createCollectionZkNode Check for collection zkNode:solrj_collection
[junit4] 2> 149471 T351 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 149473 T351 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 149476 T368 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 149477 T368 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 149470 T409 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 149480 T409 oascc.ZkStateReader.readConfigName Load collection config from:/collections/solrj_collection
[junit4] 2> 149480 T393 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/solrj_collection_shard2_replica2/'
[junit4] 2> 149487 T351 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/solrj_collection_shard1_replica2/'
[junit4] 2> 149489 T368 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/solrj_collection_shard2_replica1/'
[junit4] 2> 149496 T409 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/solrj_collection_shard1_replica1/'
[junit4] 2> 149663 T393 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 149705 T409 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 149744 T368 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 149792 T351 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 149886 T409 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 149899 T409 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 149912 T409 oass.IndexSchema.readSchema [solrj_collection_shard1_replica1] Schema name=test
[junit4] 2> 149929 T368 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 149941 T368 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 149954 T393 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 149966 T368 oass.IndexSchema.readSchema [solrj_collection_shard2_replica1] Schema name=test
[junit4] 2> 149975 T393 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 150014 T351 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 150036 T393 oass.IndexSchema.readSchema [solrj_collection_shard2_replica2] Schema name=test
[junit4] 2> 150049 T351 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 150062 T351 oass.IndexSchema.readSchema [solrj_collection_shard1_replica2] Schema name=test
[junit4] 2> 152118 T393 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 152180 T368 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 152185 T368 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 152186 T368 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 152183 T393 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 152195 T393 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 152199 T351 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 152210 T351 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 152211 T351 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 152205 T368 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 152224 T368 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 152226 T409 oass.ByteField.init WARN ByteField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 152227 T409 oass.ShortField.init WARN ShortField is deprecated and will be removed in 5.0. You should use TrieIntField instead.
[junit4] 2> 152228 T409 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 152238 T393 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 152250 T393 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 152257 T351 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 152262 T351 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 152258 T409 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 152269 T409 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 152314 T368 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 152323 T368 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 152331 T368 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 152335 T368 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 152336 T368 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 152336 T368 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 152341 T368 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 152342 T368 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 152343 T368 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 152343 T368 oasc.SolrCore.<init> [solrj_collection_shard2_replica1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/solrj_collection_shard2_replica1/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/solrj_collection_shard2_replica1/data/
[junit4] 2> 152343 T368 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@643e2052
[junit4] 2> 152347 T368 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/solrj_collection_shard2_replica1/data
[junit4] 2> 152348 T368 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/solrj_collection_shard2_replica1/data/index/
[junit4] 2> 152348 T368 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica1] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/solrj_collection_shard2_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 152349 T368 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty1-1390185490765/solrj_collection_shard2_replica1/data/index
[junit4] 2> 152350 T368 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 152351 T368 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@25a93b25 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6417f586),segFN=segments_1,generation=1}
[junit4] 2> 152352 T368 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 152358 T409 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 152360 T368 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 152361 T368 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 152362 T368 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 152363 T368 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 152365 T368 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 152366 T368 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 152367 T368 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 152368 T368 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 152368 T368 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 152369 T368 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 152370 T368 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 152370 T368 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 152371 T368 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 152370 T409 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 152373 T368 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 152374 T368 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 152376 T368 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 152379 T393 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 152387 T368 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 152389 T393 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 152399 T409 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 152402 T351 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 152406 T393 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 152406 T409 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 152407 T409 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 152407 T409 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 152412 T393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 152413 T393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 152414 T351 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 152412 T409 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 152415 T409 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 152422 T409 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 152424 T409 oasc.SolrCore.<init> [solrj_collection_shard1_replica1] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/solrj_collection_shard1_replica1/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/solrj_collection_shard1_replica1/data/
[junit4] 2> 152425 T409 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@643e2052
[junit4] 2> 152432 T351 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 152420 T368 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 152434 T368 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 152417 T393 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 152438 T409 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/solrj_collection_shard1_replica1/data
[junit4] 2> 152440 T351 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 152440 T351 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 152441 T351 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 152442 T368 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=28.5888671875, floorSegmentMB=2.0634765625, forceMergeDeletesPctAllowed=14.836128819807183, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6606925204886984
[junit4] 2> 152443 T368 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@25a93b25 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@6417f586),segFN=segments_1,generation=1}
[junit4] 2> 152444 T368 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 152445 T368 oass.SolrIndexSearcher.<init> Opening Searcher@732b5d9b main
[junit4] 2> 152447 T409 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/solrj_collection_shard1_replica1/data/index/
[junit4] 2> 153032 T409 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica1] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/solrj_collection_shard1_replica1/data/index' doesn't exist. Creating new index...
[junit4] 2> 153033 T409 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty4-1390185495694/solrj_collection_shard1_replica1/data/index
[junit4] 2> 153036 T409 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 153037 T393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 153038 T393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 153038 T393 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 153039 T393 oasc.SolrCore.<init> [solrj_collection_shard2_replica2] Opening new SolrCore at ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/solrj_collection_shard2_replica2/, dataDir=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/solrj_collection_shard2_replica2/data/
[junit4] 2> 153040 T393 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@643e2052
[junit4] 2> 153041 T393 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/solrj_collection_shard2_replica2/data
[junit4] 2> 153043 T393 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/solrj_collection_shard2_replica2/data/index/
[junit4] 2> 153043 T393 oasc.SolrCore.initIndex WARN [solrj_collection_shard2_replica2] Solr index directory './org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/solrj_collection_shard2_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 153044 T421 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica1] Registered new searcher Searcher@732b5d9b main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 153045 T409 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@67278a41 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3d08a9e),segFN=segments_1,generation=1}
[junit4] 2> 153045 T409 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 153043 T368 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica1
[junit4] 2> 153046 T368 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica1 address:http://127.0.0.1:52510/qv/j collection:solrj_collection shard:shard2
[junit4] 2> 153046 T351 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 153048 T351 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 153048 T351 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 153049 T351 oasc.SolrCore.<init> [solrj_collection_shard1_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/solrj_collection_shard1_replica2/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/solrj_collection_shard1_replica2/data/
[junit4] 2> 153051 T351 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@643e2052
[junit4] 2> 153053 T409 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 153044 T393 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/solrj_collection_shard2_replica2/data/index
[junit4] 2> 153054 T409 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 153055 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 153056 T409 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 153053 T351 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/solrj_collection_shard1_replica2/data
[junit4] 2> 153057 T351 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/solrj_collection_shard1_replica2/data/index/
[junit4] 2> 153058 T351 oasc.SolrCore.initIndex WARN [solrj_collection_shard1_replica2] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/solrj_collection_shard1_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 153056 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 153056 T368 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard2/election
[junit4] 2> 153055 T393 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 153059 T409 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 153059 T351 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-controljetty-1390185489997/solrj_collection_shard1_replica2/data/index
[junit4] 2> 153061 T409 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 153063 T409 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 153063 T409 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 153062 T351 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 153064 T409 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 153066 T393 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@33b6074a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f2a9f44),segFN=segments_1,generation=1}
[junit4] 2> 153066 T393 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 153066 T409 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 153068 T409 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 153069 T409 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 153071 T351 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@8e98841 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@42b31b33),segFN=segments_1,generation=1}
[junit4] 2> 153072 T351 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 153075 T393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 153075 T393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 153078 T393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 153092 T393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 153092 T393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 153093 T393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 153094 T393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 153095 T393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 153095 T393 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 153097 T393 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 153098 T393 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 153099 T393 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 153099 T393 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 153105 T409 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 153108 T409 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 153112 T409 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 153091 T351 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 153117 T409 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 153108 T393 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 153121 T393 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 153122 T393 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 153124 T351 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 153125 T351 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 153126 T351 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 153125 T393 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 153127 T351 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 153137 T351 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 153143 T351 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 153144 T351 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 153145 T351 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 153145 T351 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 153146 T351 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 153147 T351 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 153147 T351 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 153148 T351 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 153149 T351 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 153150 T351 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 153160 T409 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 153161 T409 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 153163 T368 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 153176 T409 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=28.5888671875, floorSegmentMB=2.0634765625, forceMergeDeletesPctAllowed=14.836128819807183, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6606925204886984
[junit4] 2> 153178 T393 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 153179 T393 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 153179 T351 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 153198 T351 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 153201 T351 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 153199 T409 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@67278a41 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3d08a9e),segFN=segments_1,generation=1}
[junit4] 2> 153199 T393 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=28.5888671875, floorSegmentMB=2.0634765625, forceMergeDeletesPctAllowed=14.836128819807183, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6606925204886984
[junit4] 2> 153206 T409 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 153207 T409 oass.SolrIndexSearcher.<init> Opening Searcher@10109ece main
[junit4] 2> 153205 T351 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=43, maxMergeAtOnceExplicit=10, maxMergedSegmentMB=28.5888671875, floorSegmentMB=2.0634765625, forceMergeDeletesPctAllowed=14.836128819807183, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6606925204886984
[junit4] 2> 153205 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 153226 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 153226 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 153221 T368 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=-11
[junit4] 2> 153228 T393 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@33b6074a lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f2a9f44),segFN=segments_1,generation=1}
[junit4] 2> 153230 T393 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 153230 T393 oass.SolrIndexSearcher.<init> Opening Searcher@7e70c691 main
[junit4] 2> 153229 T368 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Was waiting for replicas to come up, but they are taking too long - assuming they won't come back till later
[junit4] 2> 153232 T368 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C101 name=solrj_collection_shard2_replica1 org.apache.solr.core.SolrCore@4dec310d url=http://127.0.0.1:52510/qv/j/solrj_collection_shard2_replica1 node=127.0.0.1:52510_qv%2Fj C101_STATE=coll:solrj_collection core:solrj_collection_shard2_replica1 props:{state=down, base_url=http://127.0.0.1:52510/qv/j, core=solrj_collection_shard2_replica1, node_name=127.0.0.1:52510_qv%2Fj}
[junit4] 2> 153234 T368 C101 P52510 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52510/qv/j/solrj_collection_shard2_replica1/
[junit4] 2> 153235 T368 C101 P52510 oasu.PeerSync.sync PeerSync: core=solrj_collection_shard2_replica1 url=http://127.0.0.1:52510/qv/j START replicas=[http://127.0.0.1:52516/qv/j/solrj_collection_shard2_replica2/] nUpdates=100
[junit4] 2> 153241 T368 C101 P52510 oasu.PeerSync.sync PeerSync: core=solrj_collection_shard2_replica1 url=http://127.0.0.1:52510/qv/j DONE. We have no versions. sync failed.
[junit4] 2> 153246 T423 oasc.SolrCore.registerSearcher [solrj_collection_shard2_replica2] Registered new searcher Searcher@7e70c691 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 153244 T356 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 153246 T368 C101 P52510 oasc.SyncStrategy.syncReplicas Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 153266 T368 oasc.ShardLeaderElectionContext.runLeaderProcess We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 153267 T368 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52510/qv/j/solrj_collection_shard2_replica1/ shard2
[junit4] 2> 153268 T368 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leaders/shard2
[junit4] 2> 153265 T351 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(org.apache.lucene.store.RAMDirectory@8e98841 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@42b31b33),segFN=segments_1,generation=1}
[junit4] 2> 153274 T351 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 153275 T351 oass.SolrIndexSearcher.<init> Opening Searcher@133dd8da main
[junit4] 2> 153265 T424 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica1] Registered new searcher Searcher@10109ece main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 153284 T425 oasc.SolrCore.registerSearcher [solrj_collection_shard1_replica2] Registered new searcher Searcher@133dd8da main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 153273 T393 oasc.CoreContainer.registerCore registering core: solrj_collection_shard2_replica2
[junit4] 2> 153296 T393 oasc.ZkController.register Register replica - core:solrj_collection_shard2_replica2 address:http://127.0.0.1:52516/qv/j collection:solrj_collection shard:shard2
[junit4] 2> 153302 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 153305 T415 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 153306 T401 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 153306 T355 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 153307 T360 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 153306 T387 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 153310 T373 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 5)
[junit4] 2> 153332 T351 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica2
[junit4] 2> 153332 T351 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica2 address:http://127.0.0.1:52506/qv/j collection:solrj_collection shard:shard1
[junit4] 2> 153346 T409 oasc.CoreContainer.registerCore registering core: solrj_collection_shard1_replica1
[junit4] 2> 153347 T409 oasc.ZkController.register Register replica - core:solrj_collection_shard1_replica1 address:http://127.0.0.1:52519/qv/j collection:solrj_collection shard:shard1
[junit4] 2> 153366 T409 oascc.SolrZkClient.makePath makePath: /collections/solrj_collection/leader_elect/shard1/election
[junit4] 2> 153367 T355 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: Sy
[...truncated too long message...]
yFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/awholynewcollection_2_shard3_replica1/data
[junit4] 2> 316460 T401 oasc.CachingDirectoryFactory.closeCacheValue looking to close ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/awholynewcollection_2_shard3_replica1/data/index [CachedDir<<refCount=0;path=./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/awholynewcollection_2_shard3_replica1/data/index;done=false>>]
[junit4] 2> 316460 T401 oasc.CachingDirectoryFactory.close Closing directory: ./org.apache.solr.cloud.CollectionsAPIDistributedZkTest-jetty3-1390185494103/awholynewcollection_2_shard3_replica1/data/index
[junit4] 2> 316461 T401 oascc.SolrZkClient.makePath makePath: /collections/awholynewcollection_2/leaders/shard3
[junit4] 2> 316462 T401 oasc.SolrException.log ERROR There was a problem trying to register as the leader:org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:413)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:382)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:369)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 316463 T401 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_2/leader_elect/shard3/election/91107196250619914-core_node8-n_0000000003
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 316464 T401 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/awholynewcollection_2/leader_elect/shard4/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 316465 T401 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 316466 T401 oascc.ZkStateReader$2.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 316466 T401 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 316466 T401 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 316467 T401 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 316467 T401 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 316471 T401 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 316472 T401 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 316472 T401 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 316472 T401 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 316473 T401 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 175953 T332 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting, sim=DefaultSimilarity, locale=ga_IE, timezone=Africa/Asmara
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=2,free=77306448,total=197562368
[junit4] 2> NOTE: All tests run in this JVM: [HighlighterConfigTest, DebugComponentTest, EchoParamsTest, TestValueSourceCache, TestRecovery, PathHierarchyTokenizerFactoryTest, SpellingQueryConverterTest, HdfsBasicDistributedZk2Test, ReturnFieldsTest, AliasIntegrationTest, HdfsDirectoryTest, SuggesterTSTTest, ClusterStateUpdateTest, UUIDFieldTest, TestReloadAndDeleteDocs, SuggesterTest, CollectionsAPIDistributedZkTest]
[junit4] Completed in 176.28s, 1 test, 1 failure <<< FAILURES!
[...truncated 1042 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:459: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:439: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1308: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:941: There were test failures: 354 suites, 1540 tests, 1 failure, 39 ignored (5 assumptions)
Total time: 87 minutes 2 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-4.x-MacOSX (64bit/jdk1.7.0) - Build # 1215 -
Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-4.x-MacOSX/1215/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:52508/ekuh/n/collection1, http://127.0.0.1:52505/ekuh/n/collection1, http://127.0.0.1:52518/ekuh/n/collection1, http://127.0.0.1:52536/ekuh/n/collection1, http://127.0.0.1:52511/ekuh/n/collection1, http://127.0.0.1:52560/ekuh/n/collection1]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:52508/ekuh/n/collection1, http://127.0.0.1:52505/ekuh/n/collection1, http://127.0.0.1:52518/ekuh/n/collection1, http://127.0.0.1:52536/ekuh/n/collection1, http://127.0.0.1:52511/ekuh/n/collection1, http://127.0.0.1:52560/ekuh/n/collection1]
at __randomizedtesting.SeedInfo.seed([CAC3CA80A60E2A01:4B254498D1514A3D]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:352)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:640)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1162)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:149)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:52505/ekuh/n/collection1
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:495)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:283)
... 46 more
REGRESSION: org.apache.solr.cloud.OverseerTest.testStateChange
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([CAC3CA80A60E2A01:E947DEA17A2DCBD6]:0)
at org.apache.solr.cloud.OverseerTest.testStateChange(OverseerTest.java:469)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Build Log:
[...truncated 9948 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 220243 T655 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /ekuh/n
[junit4] 2> 220250 T655 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeySafeLeaderTest-1390213230730
[junit4] 2> 220252 T655 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 220253 T656 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 220355 T655 oasc.ZkTestServer.run start zk server on port:52498
[junit4] 2> 220357 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 220365 T662 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6cc70fe5 name:ZooKeeperConnection Watcher:127.0.0.1:52498 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 220365 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 220366 T655 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 220377 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 220381 T664 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1eb3aa7b name:ZooKeeperConnection Watcher:127.0.0.1:52498/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 220382 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 220382 T655 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 220391 T655 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 220400 T655 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 220407 T655 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 220415 T655 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 220416 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 220428 T655 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 220429 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 220438 T655 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 220439 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 220448 T655 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 220449 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 220457 T655 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 220458 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 220467 T655 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 220467 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 220475 T655 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 220476 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 220485 T655 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 220486 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 220496 T655 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 220496 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 220506 T655 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 220506 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 220515 T655 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 220515 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 220888 T655 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 220895 T655 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52501
[junit4] 2> 220896 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 220897 T655 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 220897 T655 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1390213231008
[junit4] 2> 220897 T655 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1390213231008/'
[junit4] 2> 220926 T655 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1390213231008/solr.xml
[junit4] 2> 221019 T655 oasc.CoreContainer.<init> New CoreContainer 1041938305
[junit4] 2> 221019 T655 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1390213231008/]
[junit4] 2> 221021 T655 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 221021 T655 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 221022 T655 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 221022 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 221022 T655 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 221023 T655 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 221023 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 221023 T655 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 221024 T655 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 221035 T655 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 221035 T655 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 221036 T655 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 221036 T655 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52498/solr
[junit4] 2> 221037 T655 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 221038 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 221043 T675 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4c059601 name:ZooKeeperConnection Watcher:127.0.0.1:52498 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 221045 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 221052 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 221056 T677 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@269f379b name:ZooKeeperConnection Watcher:127.0.0.1:52498/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 221057 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 221062 T655 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 221073 T655 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 221083 T655 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 221088 T655 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52501_ekuh%2Fn
[junit4] 2> 221090 T655 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52501_ekuh%2Fn
[junit4] 2> 221100 T655 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 221107 T655 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 221121 T655 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 221129 T655 oasc.Overseer.start Overseer (id=91109014289514499-127.0.0.1:52501_ekuh%2Fn-n_0000000000) starting
[junit4] 2> 221138 T655 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 221148 T679 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 221150 T655 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 221151 T679 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 221158 T655 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 221163 T655 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 221172 T678 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 221183 T680 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 221184 T680 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 221186 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 221186 T680 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 221191 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 221193 T678 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52501/ekuh/n",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52501_ekuh%2Fn",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 221193 T678 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 221193 T678 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 221202 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 221204 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 222191 T680 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 222191 T680 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1390213231008/collection1
[junit4] 2> 222191 T680 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 222194 T680 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 222194 T680 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 222198 T680 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1390213231008/collection1/'
[junit4] 2> 222199 T680 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1390213231008/collection1/lib/classes/' to classloader
[junit4] 2> 222199 T680 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1390213231008/collection1/lib/README' to classloader
[junit4] 2> 222273 T680 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 222356 T680 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 222361 T680 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 222373 T680 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 223001 T680 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 223006 T680 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 223007 T680 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 223015 T680 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 223098 T680 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 223123 T680 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1390213231008/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/control/data/
[junit4] 2> 223124 T680 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@77682363
[junit4] 2> 223126 T680 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/control/data
[junit4] 2> 223127 T680 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/control/data/index/
[junit4] 2> 223128 T680 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 223129 T680 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/control/data/index
[junit4] 2> 223130 T680 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=26.5390625, floorSegmentMB=2.0908203125, forceMergeDeletesPctAllowed=13.919117475777965, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8802409523891396
[junit4] 2> 223135 T680 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 223135 T680 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 223139 T680 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 223140 T680 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 223140 T680 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 223140 T680 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 223141 T680 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 223142 T680 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 223142 T680 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 223143 T680 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 223143 T680 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 223144 T680 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 223145 T680 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 223145 T680 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 223145 T680 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 223146 T680 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 223146 T680 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 223147 T680 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 223156 T680 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 223161 T680 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 223161 T680 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 223162 T680 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 223164 T680 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 223164 T680 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 223164 T680 oass.SolrIndexSearcher.<init> Opening Searcher@3cd03250 main
[junit4] 2> 223172 T681 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@3cd03250 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 223174 T680 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 223176 T655 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 223176 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 223176 T684 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52501/ekuh/n collection:control_collection shard:shard1
[junit4] 2> 223180 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 223183 T684 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 223185 T686 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@73afcf0a name:ZooKeeperConnection Watcher:127.0.0.1:52498/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 223185 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 223189 T655 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 223199 T655 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 223208 T684 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 223215 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 223220 T684 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 223220 T684 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C342 name=collection1 org.apache.solr.core.SolrCore@2aab9ecf url=http://127.0.0.1:52501/ekuh/n/collection1 node=127.0.0.1:52501_ekuh%2Fn C342_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:52501/ekuh/n, core=collection1, node_name=127.0.0.1:52501_ekuh%2Fn}
[junit4] 2> 223221 T684 C342 P52501 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52501/ekuh/n/collection1/
[junit4] 2> 223222 T684 C342 P52501 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 223223 T684 C342 P52501 oasc.SyncStrategy.syncToMe http://127.0.0.1:52501/ekuh/n/collection1/ has no replicas
[junit4] 2> 223223 T684 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52501/ekuh/n/collection1/ shard1
[junit4] 2> 223224 T684 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 223227 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 223247 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 223251 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 223255 T686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 223268 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 223277 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 223384 T686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 223384 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 223413 T684 oasc.ZkController.register We are http://127.0.0.1:52501/ekuh/n/collection1/ and leader is http://127.0.0.1:52501/ekuh/n/collection1/
[junit4] 2> 223414 T684 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52501/ekuh/n
[junit4] 2> 223414 T684 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 223414 T684 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 223414 T684 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 223419 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 223420 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 223420 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 223425 T684 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 223432 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 223434 T678 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:52501/ekuh/n",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52501_ekuh%2Fn",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 223440 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 223547 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 223548 T686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 223563 T655 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 223568 T655 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52505
[junit4] 2> 223570 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 223570 T655 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 223570 T655 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1390213233679
[junit4] 2> 223571 T655 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1390213233679/'
[junit4] 2> 223600 T655 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1390213233679/solr.xml
[junit4] 2> 223689 T655 oasc.CoreContainer.<init> New CoreContainer 1409207208
[junit4] 2> 223690 T655 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1390213233679/]
[junit4] 2> 223691 T655 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 223692 T655 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 223692 T655 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 223692 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 223692 T655 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 223693 T655 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 223693 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 223694 T655 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 223694 T655 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 223704 T655 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 223705 T655 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 223706 T655 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 223706 T655 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52498/solr
[junit4] 2> 223707 T655 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 223708 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 223713 T697 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7cecadac name:ZooKeeperConnection Watcher:127.0.0.1:52498 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 223714 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 223721 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 223725 T699 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2b7d43d3 name:ZooKeeperConnection Watcher:127.0.0.1:52498/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 223725 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 223738 T655 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 224752 T655 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52505_ekuh%2Fn
[junit4] 2> 224755 T655 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52505_ekuh%2Fn
[junit4] 2> 224764 T677 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 224766 T699 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 224765 T686 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 224789 T700 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 224790 T700 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 224792 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 224792 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 224793 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 224792 T700 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 224798 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 224800 T678 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52505/ekuh/n",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52505_ekuh%2Fn",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 224800 T678 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 224801 T678 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 224809 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 224919 T686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 224919 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 224919 T699 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 225795 T700 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 225796 T700 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1390213233679/collection1
[junit4] 2> 225796 T700 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 225798 T700 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 225798 T700 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 225802 T700 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1390213233679/collection1/'
[junit4] 2> 225803 T700 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1390213233679/collection1/lib/classes/' to classloader
[junit4] 2> 225803 T700 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1390213233679/collection1/lib/README' to classloader
[junit4] 2> 225876 T700 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 225948 T700 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 225951 T700 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 225960 T700 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 226610 T700 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 226613 T700 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 226615 T700 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 226625 T700 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 226718 T700 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 226719 T700 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1390213233679/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty1/
[junit4] 2> 226719 T700 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@77682363
[junit4] 2> 226721 T700 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty1
[junit4] 2> 226722 T700 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty1/index/
[junit4] 2> 226722 T700 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 226723 T700 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty1/index
[junit4] 2> 226724 T700 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=26.5390625, floorSegmentMB=2.0908203125, forceMergeDeletesPctAllowed=13.919117475777965, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8802409523891396
[junit4] 2> 226727 T700 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 226727 T700 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 226733 T700 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 226733 T700 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 226734 T700 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 226734 T700 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 226734 T700 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 226735 T700 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 226735 T700 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 226736 T700 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 226736 T700 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 226737 T700 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 226739 T700 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 226739 T700 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 226739 T700 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 226740 T700 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 226741 T700 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 226742 T700 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 226751 T700 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 226755 T700 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 226755 T700 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 226756 T700 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 226758 T700 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 226758 T700 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 226758 T700 oass.SolrIndexSearcher.<init> Opening Searcher@22c0748e main
[junit4] 2> 226763 T701 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@22c0748e main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 226767 T700 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 226770 T655 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 226770 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 226770 T704 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52505/ekuh/n collection:collection1 shard:shard3
[junit4] 2> 226774 T704 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 226798 T704 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 226805 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226805 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226806 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226807 T704 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 226808 T704 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C343 name=collection1 org.apache.solr.core.SolrCore@117812c8 url=http://127.0.0.1:52505/ekuh/n/collection1 node=127.0.0.1:52505_ekuh%2Fn C343_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:52505/ekuh/n, core=collection1, node_name=127.0.0.1:52505_ekuh%2Fn}
[junit4] 2> 226808 T704 C343 P52505 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52505/ekuh/n/collection1/
[junit4] 2> 226809 T704 C343 P52505 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 226809 T704 C343 P52505 oasc.SyncStrategy.syncToMe http://127.0.0.1:52505/ekuh/n/collection1/ has no replicas
[junit4] 2> 226810 T704 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52505/ekuh/n/collection1/ shard3
[junit4] 2> 226810 T704 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 226815 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 226854 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 226859 T686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 226862 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 226865 T699 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 226887 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 226899 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 227006 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 227006 T699 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 227007 T686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 227044 T704 oasc.ZkController.register We are http://127.0.0.1:52505/ekuh/n/collection1/ and leader is http://127.0.0.1:52505/ekuh/n/collection1/
[junit4] 2> 227044 T704 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52505/ekuh/n
[junit4] 2> 227045 T704 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 227045 T704 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 227045 T704 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 227048 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 227049 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 227049 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 227050 T704 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 227053 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 227055 T678 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:52505/ekuh/n",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52505_ekuh%2Fn",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 227062 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 227168 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 227168 T699 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 227168 T686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 227181 T655 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 227186 T655 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52508
[junit4] 2> 227188 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 227188 T655 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 227189 T655 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1390213237250
[junit4] 2> 227190 T655 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1390213237250/'
[junit4] 2> 227219 T655 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1390213237250/solr.xml
[junit4] 2> 227307 T655 oasc.CoreContainer.<init> New CoreContainer 2015168277
[junit4] 2> 227307 T655 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1390213237250/]
[junit4] 2> 227309 T655 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 227309 T655 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 227309 T655 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 227310 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 227310 T655 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 227310 T655 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 227311 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 227311 T655 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 227312 T655 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 227322 T655 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 227322 T655 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 227323 T655 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 227323 T655 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52498/solr
[junit4] 2> 227324 T655 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 227325 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 227330 T715 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@39bc314e name:ZooKeeperConnection Watcher:127.0.0.1:52498 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 227331 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 227337 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 227341 T717 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62cfb9d8 name:ZooKeeperConnection Watcher:127.0.0.1:52498/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 227341 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 227353 T655 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 228364 T655 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52508_ekuh%2Fn
[junit4] 2> 228367 T655 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52508_ekuh%2Fn
[junit4] 2> 228375 T699 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 228375 T686 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 228375 T717 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 228376 T677 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 228399 T718 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 228399 T718 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 228402 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 228403 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 228403 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 228402 T718 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 228407 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 228409 T678 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52508/ekuh/n",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52508_ekuh%2Fn",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 228409 T678 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 228409 T678 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 228417 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 228525 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 228525 T699 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 228525 T686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 228525 T717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 229405 T718 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 229406 T718 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1390213237250/collection1
[junit4] 2> 229406 T718 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 229408 T718 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 229408 T718 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 229412 T718 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1390213237250/collection1/'
[junit4] 2> 229414 T718 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1390213237250/collection1/lib/classes/' to classloader
[junit4] 2> 229414 T718 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1390213237250/collection1/lib/README' to classloader
[junit4] 2> 229496 T718 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_47
[junit4] 2> 229573 T718 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 229577 T718 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 229585 T718 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 230242 T718 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 230245 T718 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 230250 T718 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 230259 T718 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 230342 T718 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 230343 T718 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1390213237250/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty2/
[junit4] 2> 230344 T718 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@77682363
[junit4] 2> 230345 T718 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty2
[junit4] 2> 230345 T718 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty2/index/
[junit4] 2> 230346 T718 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 230347 T718 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty2/index
[junit4] 2> 230348 T718 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=46, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=26.5390625, floorSegmentMB=2.0908203125, forceMergeDeletesPctAllowed=13.919117475777965, segmentsPerTier=40.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8802409523891396
[junit4] 2> 230351 T718 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 230351 T718 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 230357 T718 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 230358 T718 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 230358 T718 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 230359 T718 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 230360 T718 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 230360 T718 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 230361 T718 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 230361 T718 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 230362 T718 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 230362 T718 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 230363 T718 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 230363 T718 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 230364 T718 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 230364 T718 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 230365 T718 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 230366 T718 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 230375 T718 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 230379 T718 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 230380 T718 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 230381 T718 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=44, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 230382 T718 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1390213230730/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 230382 T718 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 230383 T718 oass.SolrIndexSearcher.<init> Opening Searcher@170cd3b6 main
[junit4] 2> 230387 T719 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@170cd3b6 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 230392 T718 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 230394 T655 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 230394 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 230394 T722 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52508/ekuh/n collection:collection1 shard:shard1
[junit4] 2> 230397 T722 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 230413 T722 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 230422 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 230422 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 230422 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 230423 T722 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 230423 T722 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C344 name=collection1 org.apache.solr.core.SolrCore@3cdf2a05 url=http://127.0.0.1:52508/ekuh/n/collection1 node=127.0.0.1:52508_ekuh%2Fn C344_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:52508/ekuh/n, core=collection1, node_name=127.0.0.1:52508_ekuh%2Fn}
[junit4] 2> 230426 T722 C344 P52508 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52508/ekuh/n/collection1/
[junit4] 2> 230426 T722 C344 P52508 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 230427 T722 C344 P52508 oasc.SyncStrategy.syncToMe http://127.0.0.1:52508/ekuh/n/collection1/ has no replicas
[junit4] 2> 230427 T722 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52508/ekuh/n/collection1/ shard1
[junit4] 2> 230428 T722 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 230434 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 230444 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 230447 T699 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230448 T686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230449 T717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230450 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230469 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 230475 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 230484 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 230598 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230599 T686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230599 T717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230600 T699 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230626 T722 oasc.ZkController.register We are http://127.0.0.1:52508/ekuh/n/collection1/ and leader is http://127.0.0.1:52508/ekuh/n/collection1/
[junit4] 2> 230627 T722 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52508/ekuh/n
[junit4] 2> 230627 T722 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 230627 T722 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 230627 T722 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 230644 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 230645 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 230645 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 230666 T722 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 230691 T678 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 230709 T678 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:52508/ekuh/n",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52508_ekuh%2Fn",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 230742 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 230823 T655 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 230829 T655 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52511
[junit4] 2> 230830 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 230831 T655 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 230832 T655 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1390213240874
[junit4] 2> 230832 T655 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1390213240874/'
[junit4] 2> 230871 T686 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230871 T717 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230872 T677 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230873 T699 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 230878 T655 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1390213240874/solr.xml
[junit4] 2> 231042 T655 oasc.CoreContainer.<init> New CoreContainer 231705093
[junit4] 2> 231042 T655 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1390213240874/]
[junit4] 2> 231044 T655 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 231045 T655 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 231046 T655 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 231046 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 231046 T655 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 231047 T655 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 231047 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 231047 T655 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 231048 T655 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 231058 T655 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 231058 T655 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 231059 T655 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 231059 T655 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52498/solr
[junit4] 2> 231060 T655 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 231061 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 231066 T733 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@346e5558 name:ZooKeeperConnection Watcher:127.0.0.1:52498 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 231067 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 231075 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 231078 T735 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ae05a90 name:ZooKeeperConnection Watcher:127.0.0.1:52498/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 231079 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 231094 T655 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 232105 T655 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52511_ekuh%2Fn
[junit4] 2> 232108 T655 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52511_ekuh%2Fn
[junit4] 2> 232118 T735 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 232118 T717 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 232119 T686 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 232118 T699 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 232119 T677 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 232142 T736 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 232142 T736 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 232144 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 232145 T736 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 232145 T677 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /oversee
[...truncated too long message...]
[junit4] 2> 2535536 T6203 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 2535542 T6203 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 2535555 T6203 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 2535576 T6203 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 2535582 T6203 oasc.Overseer.start Overseer (id=91109166002339844-127.0.0.1:54444_solr-n_0000000000) starting
[junit4] 2> 2535588 T6203 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 2535597 T6203 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 2535605 T6203 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 2535610 T6546 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 2535612 T6546 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 2535613 T6545 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 2535617 T6544 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2535621 T6545 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2535623 T6545 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=12 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"recovering",
[junit4] 2> "node_name":"node1",
[junit4] 2> "core":"core1",
[junit4] 2> "core_node_name":"node1",
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"12",
[junit4] 2> "base_url":"http://node1/solr/"}
[junit4] 2> 2535623 T6545 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3, shard4, shard5, shard6, shard7, shard8, shard9, shard10, shard11, shard12]
[junit4] 2> 2535623 T6545 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard12
[junit4] 2> 2535629 T6544 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2535631 T6542 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2535631 T6536 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 2536119 T6203 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard12/election
[junit4] 2> 2536170 T6203 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard12
[junit4] 2> 2536200 T6544 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2536203 T6203 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2536207 T6545 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 2536220 T6536 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2536220 T6542 oascc.ZkStateReader$3.process Updating live nodes... (0)
[junit4] 2> 2536482 T6203 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:54444 54444
[junit4] 2> 2536527 T6203 oas.SolrTestCaseJ4.tearDown ###Ending testPlaceholders
[junit4] 1> client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2536534 T6203 oas.SolrTestCaseJ4.initCore ####initCore
[junit4] 2> 2536534 T6203 oas.SolrTestCaseJ4.initCore ####initCore end
[junit4] 2> 2539536 T6203 oas.SolrTestCaseJ4.deleteCore ###deleteCore
[junit4] 2> NOTE: test params are: codec=Appending, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=sv_SE, timezone=Asia/Pyongyang
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=1,free=190703456,total=390180864
[junit4] 2> NOTE: All tests run in this JVM: [TestPHPSerializedResponseWriter, TestSystemIdResolver, TestFuzzyAnalyzedSuggestions, DebugComponentTest, DOMUtilTest, TestClassNameShortening, TestUpdate, BlockDirectoryTest, TestJmxIntegration, AssignTest, SpatialFilterTest, TestSolrQueryParser, RecoveryZkTest, TestCoreContainer, CursorMarkTest, TestSimpleQParserPlugin, MigrateRouteKeyTest, PrimUtilsTest, TestLazyCores, TestFastOutputStream, NoCacheHeaderTest, TestManagedSchemaFieldResource, CoreAdminCreateDiscoverTest, IndexSchemaTest, ChaosMonkeySafeLeaderTest, DistributedQueryComponentCustomSortTest, TestZkChroot, HardAutoCommitTest, AddBlockUpdateTest, DistributedTermsComponentTest, TestComponentsName, TestLRUCache, TestDynamicFieldResource, TestSchemaResource, DistributedSuggestComponentTest, ShardRoutingTest, BadCopyFieldTest, SpellPossibilityIteratorTest, TermVectorComponentDistributedTest, SearchHandlerTest, MoreLikeThisHandlerTest, FileUtilsTest, WordBreakSolrSpellCheckerTest, TestAtomicUpdateErrorCases, DirectUpdateHandlerOptimizeTest, TestDefaultSimilarityFactory, CircularListTest, CacheHeaderTest, TestIndexSearcher, OpenExchangeRatesOrgProviderTest, JSONWriterTest, CachingDirectoryFactoryTest, UniqFieldsUpdateProcessorFactoryTest, ScriptEngineTest, TestSolrXMLSerializer, TestGroupingSearch, TestDocSet, CoreAdminHandlerTest, DocValuesMissingTest, URLClassifyProcessorTest, TestJoin, ZkControllerTest, TestWordDelimiterFilterFactory, TestFieldTypeResource, TermVectorComponentTest, TestAddFieldRealTimeGet, RegexBoostProcessorTest, TestDFRSimilarityFactory, RequiredFieldsTest, MinimalSchemaTest, TestLMJelinekMercerSimilarityFactory, TestReversedWildcardFilterFactory, TestStressRecovery, JsonLoaderTest, TestPerFieldSimilarity, AutoCommitTest, DistributedDebugComponentTest, PreAnalyzedFieldTest, AliasIntegrationTest, DirectSolrSpellCheckerTest, TestSolrIndexConfig, TestPseudoReturnFields, SpellingQueryConverterTest, TestSort, TestInfoStreamLogging, PeerSyncTest, TestExtendedDismaxParser, DistribCursorPagingTest, TestDistributedSearch, TestLMDirichletSimilarityFactory, HdfsBasicDistributedZk2Test, TestCursorMarkWithoutUniqueKey, SOLR749Test, SoftAutoCommitTest, DocumentAnalysisRequestHandlerTest, TimeZoneUtilsTest, CopyFieldTest, TestAnalyzedSuggestions, TestSchemaSimilarityResource, TestSearchPerf, ZkSolrClientTest, TestFaceting, FieldMutatingUpdateProcessorTest, StatsComponentTest, ResponseLogComponentTest, TestReload, SchemaVersionSpecificBehaviorTest, ParsingFieldUpdateProcessorsTest, ConvertedLegacyTest, TestCSVLoader, TestReloadAndDeleteDocs, TestStressLucene, TestPostingsSolrHighlighter, LeaderElectionIntegrationTest, SolrIndexSplitterTest, TestIBSimilarityFactory, CollectionsAPIDistributedZkTest, OutputWriterTest, TestCollationField, ChangedSchemaMergeTest, CurrencyFieldXmlFileTest, TestDistribDocBasedVersion, TestFieldCollectionResource, TestXIncludeConfig, SuggesterFSTTest, TestCodecSupport, TestIndexingPerformance, HighlighterTest, FieldAnalysisRequestHandlerTest, StressHdfsTest, NotRequiredUniqueKeyTest, TestDistributedGrouping, SliceStateUpdateTest, DocValuesTest, XmlUpdateRequestHandlerTest, HdfsChaosMonkeySafeLeaderTest, LukeRequestHandlerTest, TestReplicationHandler, ShowFileRequestHandlerTest, TestNoOpRegenerator, UpdateRequestProcessorFactoryTest, TestManagedSchema, SolrRequestParserTest, TestCSVResponseWriter, XsltUpdateRequestHandlerTest, CoreContainerCoreInitFailuresTest, SimpleFacetsTest, TestSolrCoreProperties, TestAnalyzeInfixSuggestions, SolrPluginUtilsTest, TestStressReorder, ExternalFileFieldSortTest, TestPhraseSuggestions, TestSweetSpotSimilarityFactory, TestElisionMultitermQuery, TestBM25SimilarityFactory, HdfsUnloadDistributedZkTest, BadComponentTest, TestFileDictionaryLookup, DistributedQueryElevationComponentTest, SolrXmlInZkTest, TestCustomSort, PrimitiveFieldTypeTest, PreAnalyzedUpdateProcessorTest, PathHierarchyTokenizerFactoryTest, TestOmitPositions, BJQParserTest, SolrCoreTest, CurrencyFieldOpenExchangeTest, CoreMergeIndexesAdminHandlerTest, QueryElevationComponentTest, SyncSliceTest, TestFunctionQuery, BasicDistributedZkTest, BasicDistributedZk2Test, UnloadDistributedZkTest, OpenCloseCoreStressTest, OverseerTest]
[junit4] Completed in 40.16s, 8 tests, 1 error <<< FAILURES!
[...truncated 531 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:459: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:439: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:1308: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-4.x-MacOSX/lucene/common-build.xml:941: There were test failures: 354 suites, 1540 tests, 2 errors, 39 ignored (5 assumptions)
Total time: 90 minutes 12 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure