You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/02/05 15:08:18 UTC
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1298
- Failure!
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1298/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.BasicDistributedZkTest.testDistribSearch
Error Message:
commitWithin did not work expected:<68> but was:<67>
Stack Trace:
java.lang.AssertionError: commitWithin did not work expected:<68> but was:<67>
at __randomizedtesting.SeedInfo.seed([3A1CD6E0D33C1676:BBFA58F8A463764A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.BasicDistributedZkTest.doTest(BasicDistributedZkTest.java:354)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
REGRESSION: org.apache.solr.cloud.OverseerRolesTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=9452, name=Overseer-91200478082039824-127.0.0.1:59479__rwo-n_0000000013, state=RUNNABLE, group=Overseer collection creation process.]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=9452, name=Overseer-91200478082039824-127.0.0.1:59479__rwo-n_0000000013, state=RUNNABLE, group=Overseer collection creation process.]
at __randomizedtesting.SeedInfo.seed([3A1CD6E0D33C1676:BBFA58F8A463764A]:0)
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
at __randomizedtesting.SeedInfo.seed([3A1CD6E0D33C1676]:0)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:209)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qn-0000000004
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1151)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:273)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:270)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:270)
at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:192)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
... 1 more
Build Log:
[...truncated 10154 lines...]
[junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
[junit4] 2> 875781 T2281 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
[junit4] 2> 875786 T2281 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-BasicDistributedZkTest-1391606902823
[junit4] 2> 875788 T2281 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 875789 T2282 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 875889 T2281 oasc.ZkTestServer.run start zk server on port:52318
[junit4] 2> 875891 T2281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 875899 T2288 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78cb8e0e name:ZooKeeperConnection Watcher:127.0.0.1:52318 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 875899 T2281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 875900 T2281 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 875913 T2281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 875917 T2290 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@704e7a0d name:ZooKeeperConnection Watcher:127.0.0.1:52318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 875918 T2281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 875918 T2281 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 875924 T2281 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 875931 T2281 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 875941 T2281 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 875949 T2281 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 875950 T2281 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 875968 T2281 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 875969 T2281 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 875975 T2281 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 875975 T2281 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 875982 T2281 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 875982 T2281 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 875988 T2281 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 875989 T2281 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 875995 T2281 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 875996 T2281 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 876002 T2281 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 876002 T2281 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 876008 T2281 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 876009 T2281 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 876014 T2281 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 876015 T2281 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 876021 T2281 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 876022 T2281 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 876029 T2281 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 876030 T2281 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 876484 T2281 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 876491 T2281 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52321
[junit4] 2> 876492 T2281 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 876492 T2281 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 876492 T2281 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1391606903073
[junit4] 2> 876494 T2281 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1391606903073/'
[junit4] 2> 876540 T2281 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1391606903073/solr.xml
[junit4] 2> 876654 T2281 oasc.CoreContainer.<init> New CoreContainer 172266662
[junit4] 2> 876654 T2281 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1391606903073/]
[junit4] 2> 876657 T2281 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 876658 T2281 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 876658 T2281 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 876659 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 876659 T2281 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 876660 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 876660 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 876661 T2281 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 876661 T2281 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 876677 T2281 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 876678 T2281 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 876679 T2281 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 876679 T2281 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52318/solr
[junit4] 2> 876680 T2281 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 876681 T2281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 876687 T2301 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c7b238e name:ZooKeeperConnection Watcher:127.0.0.1:52318 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 876689 T2281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 876694 T2281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 876700 T2303 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16e43857 name:ZooKeeperConnection Watcher:127.0.0.1:52318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 876701 T2281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 876705 T2281 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 876715 T2281 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 876724 T2281 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 876733 T2281 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52321_
[junit4] 2> 876735 T2281 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52321_
[junit4] 2> 876744 T2281 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 876750 T2281 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 876762 T2281 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:52321_
[junit4] 2> 876763 T2281 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 876769 T2281 oasc.Overseer.start Overseer (id=91200349983735811-127.0.0.1:52321_-n_0000000000) starting
[junit4] 2> 876777 T2281 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 876788 T2305 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 876791 T2305 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 876793 T2281 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 876801 T2281 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 876806 T2281 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 876814 T2304 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 877160 T2306 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 877161 T2306 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 877163 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 877163 T2306 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 877166 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 877167 T2304 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52321",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52321_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 877167 T2304 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 877167 T2304 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 877173 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 877176 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 878166 T2306 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 878167 T2306 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1391606903073/collection1
[junit4] 2> 878167 T2306 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 878168 T2306 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 878169 T2306 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 878171 T2306 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1391606903073/collection1/'
[junit4] 2> 878173 T2306 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1391606903073/collection1/lib/classes/' to classloader
[junit4] 2> 878174 T2306 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1391606903073/collection1/lib/README' to classloader
[junit4] 2> 878265 T2306 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 878372 T2306 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 878377 T2306 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 878392 T2306 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 879202 T2306 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 879212 T2306 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 879216 T2306 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 879242 T2306 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 879248 T2306 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 879253 T2306 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 879256 T2306 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 879256 T2306 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 879257 T2306 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 879259 T2306 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 879259 T2306 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 879259 T2306 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 879259 T2306 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-controljetty-1391606903073/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/control/data/
[junit4] 2> 879260 T2306 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@31e4f220
[junit4] 2> 879260 T2306 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/control/data
[junit4] 2> 879261 T2306 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/control/data/index/
[junit4] 2> 879261 T2306 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 879261 T2306 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/control/data/index
[junit4] 2> 879261 T2306 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=2.0576171875, floorSegmentMB=1.3798828125, forceMergeDeletesPctAllowed=17.48292297400321, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7594127430991644
[junit4] 2> 879262 T2306 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@18d971f3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@505c98e0),segFN=segments_1,generation=1}
[junit4] 2> 879262 T2306 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 879267 T2306 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 879267 T2306 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 879267 T2306 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 879268 T2306 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 879268 T2306 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 879268 T2306 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 879269 T2306 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 879269 T2306 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 879269 T2306 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 879270 T2306 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 879270 T2306 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 879271 T2306 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 879271 T2306 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 879271 T2306 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 879272 T2306 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 879272 T2306 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 879273 T2306 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 879282 T2306 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 879288 T2306 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 879288 T2306 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 879289 T2306 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=33, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 879289 T2306 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@18d971f3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@505c98e0),segFN=segments_1,generation=1}
[junit4] 2> 879290 T2306 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 879290 T2306 oass.SolrIndexSearcher.<init> Opening Searcher@16dd4011 main
[junit4] 2> 879295 T2306 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 879295 T2307 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16dd4011 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 879296 T2281 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 879297 T2281 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 879297 T2310 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52321 collection:control_collection shard:shard1
[junit4] 2> 879302 T2281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 879304 T2312 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@689687ca name:ZooKeeperConnection Watcher:127.0.0.1:52318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 879305 T2281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 879306 T2310 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 879309 T2281 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 879318 T2281 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 879344 T2310 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 879350 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 879351 T2310 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 879352 T2310 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2434 name=collection1 org.apache.solr.core.SolrCore@5de483a0 url=http://127.0.0.1:52321/collection1 node=127.0.0.1:52321_ C2434_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:52321, core=collection1, node_name=127.0.0.1:52321_}
[junit4] 2> 879352 T2310 C2434 P52321 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52321/collection1/
[junit4] 2> 879353 T2310 C2434 P52321 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 879354 T2310 C2434 P52321 oasc.SyncStrategy.syncToMe http://127.0.0.1:52321/collection1/ has no replicas
[junit4] 2> 879354 T2310 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52321/collection1/ shard1
[junit4] 2> 879354 T2310 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 879357 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 879371 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 879375 T2312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 879375 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 879387 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 879394 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 879501 T2312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 879501 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 879537 T2310 oasc.ZkController.register We are http://127.0.0.1:52321/collection1/ and leader is http://127.0.0.1:52321/collection1/
[junit4] 2> 879537 T2310 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52321
[junit4] 2> 879537 T2310 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 879538 T2310 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 879538 T2310 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 879545 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 879545 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 879545 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 879550 T2310 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 879563 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 879569 T2304 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:52321",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52321_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 879589 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 879702 T2312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 879702 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 879793 T2281 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 879794 T2281 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 879800 T2281 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52325
[junit4] 2> 879800 T2281 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 879800 T2281 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 879801 T2281 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1391606906354
[junit4] 2> 879801 T2281 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1391606906354/'
[junit4] 2> 879840 T2281 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1391606906354/solr.xml
[junit4] 2> 879936 T2281 oasc.CoreContainer.<init> New CoreContainer 572416708
[junit4] 2> 879936 T2281 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1391606906354/]
[junit4] 2> 879938 T2281 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 879938 T2281 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 879939 T2281 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 879939 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 879940 T2281 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 879940 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 879940 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 879941 T2281 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 879941 T2281 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 879955 T2281 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 879956 T2281 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 879956 T2281 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 879956 T2281 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52318/solr
[junit4] 2> 879956 T2281 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 879958 T2281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 879965 T2323 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78e6435b name:ZooKeeperConnection Watcher:127.0.0.1:52318 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 879966 T2281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 879970 T2281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 879974 T2325 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e22bcda name:ZooKeeperConnection Watcher:127.0.0.1:52318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 879974 T2281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 879983 T2281 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 880991 T2281 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52325_
[junit4] 2> 880993 T2281 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52325_
[junit4] 2> 880998 T2303 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 881003 T2312 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 881008 T2325 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 881017 T2326 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 881017 T2326 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 881020 T2326 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 881021 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 881021 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 881021 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 881025 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 881026 T2304 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52325",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52325_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 881027 T2304 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
[junit4] 2> 881027 T2304 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 881034 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 881140 T2325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 881140 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 881149 T2312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 882022 T2326 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 882023 T2326 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1391606906354/collection1
[junit4] 2> 882023 T2326 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 882025 T2326 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 882025 T2326 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 882029 T2326 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1391606906354/collection1/'
[junit4] 2> 882030 T2326 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1391606906354/collection1/lib/classes/' to classloader
[junit4] 2> 882031 T2326 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1391606906354/collection1/lib/README' to classloader
[junit4] 2> 882144 T2326 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 882242 T2326 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 882248 T2326 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 882262 T2326 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 882867 T2326 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 882876 T2326 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 882880 T2326 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 882905 T2326 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 882910 T2326 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 882916 T2326 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 882918 T2326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 882919 T2326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 882919 T2326 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 882921 T2326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 882922 T2326 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 882922 T2326 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 882922 T2326 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty1-1391606906354/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/jetty1/
[junit4] 2> 882923 T2326 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@31e4f220
[junit4] 2> 882923 T2326 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/jetty1
[junit4] 2> 882924 T2326 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/jetty1/index/
[junit4] 2> 882924 T2326 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 882925 T2326 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/jetty1/index
[junit4] 2> 882925 T2326 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=2.0576171875, floorSegmentMB=1.3798828125, forceMergeDeletesPctAllowed=17.48292297400321, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7594127430991644
[junit4] 2> 882926 T2326 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76381da9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@56a16a5e),segFN=segments_1,generation=1}
[junit4] 2> 882926 T2326 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 882931 T2326 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 882932 T2326 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 882932 T2326 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 882932 T2326 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 882933 T2326 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 882933 T2326 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 882933 T2326 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 882934 T2326 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 882934 T2326 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 882935 T2326 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 882935 T2326 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 882935 T2326 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 882936 T2326 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 882936 T2326 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 882937 T2326 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 882937 T2326 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 882938 T2326 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 882949 T2326 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 882953 T2326 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 882954 T2326 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 882955 T2326 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=33, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 882956 T2326 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@76381da9 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@56a16a5e),segFN=segments_1,generation=1}
[junit4] 2> 882956 T2326 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 882956 T2326 oass.SolrIndexSearcher.<init> Opening Searcher@680decde main
[junit4] 2> 882962 T2327 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@680decde main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 882966 T2326 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 882968 T2281 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 882968 T2281 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 882968 T2330 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52325 collection:collection1 shard:shard1
[junit4] 2> 882979 T2330 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 883000 T2330 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 883007 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883007 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883008 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883009 T2330 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 883010 T2330 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2435 name=collection1 org.apache.solr.core.SolrCore@7f9e82dc url=http://127.0.0.1:52325/collection1 node=127.0.0.1:52325_ C2435_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:52325, core=collection1, node_name=127.0.0.1:52325_}
[junit4] 2> 883010 T2330 C2435 P52325 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52325/collection1/
[junit4] 2> 883010 T2330 C2435 P52325 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 883011 T2330 C2435 P52325 oasc.SyncStrategy.syncToMe http://127.0.0.1:52325/collection1/ has no replicas
[junit4] 2> 883011 T2330 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52325/collection1/ shard1
[junit4] 2> 883011 T2330 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 883014 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 883028 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883043 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 883044 T2325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 883046 T2312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 883068 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 883082 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883192 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 883193 T2325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 883193 T2312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 883205 T2330 oasc.ZkController.register We are http://127.0.0.1:52325/collection1/ and leader is http://127.0.0.1:52325/collection1/
[junit4] 2> 883206 T2330 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52325
[junit4] 2> 883206 T2330 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 883206 T2330 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 883206 T2330 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 883208 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883209 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883209 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883209 T2330 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 883217 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 883219 T2304 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:52325",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52325_",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 883225 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 883340 T2312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 883341 T2325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 883342 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 883425 T2281 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 883426 T2281 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 883441 T2281 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52328
[junit4] 2> 883441 T2281 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 883443 T2281 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 883443 T2281 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1391606910005
[junit4] 2> 883443 T2281 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1391606910005/'
[junit4] 2> 883474 T2281 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1391606910005/solr.xml
[junit4] 2> 883548 T2281 oasc.CoreContainer.<init> New CoreContainer 494843523
[junit4] 2> 883549 T2281 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1391606910005/]
[junit4] 2> 883550 T2281 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 883551 T2281 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 883551 T2281 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 883551 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 883551 T2281 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 883552 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 883552 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 883552 T2281 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 883552 T2281 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 883563 T2281 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 883563 T2281 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 883564 T2281 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 883564 T2281 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52318/solr
[junit4] 2> 883564 T2281 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 883566 T2281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 883571 T2341 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a006195 name:ZooKeeperConnection Watcher:127.0.0.1:52318 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 883572 T2281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 883576 T2281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 883597 T2343 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46748a6c name:ZooKeeperConnection Watcher:127.0.0.1:52318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 883598 T2281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 883605 T2281 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 884616 T2281 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52328_
[junit4] 2> 884618 T2281 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52328_
[junit4] 2> 884631 T2325 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 884631 T2312 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 884632 T2303 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 884632 T2343 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 884650 T2344 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 884650 T2344 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 884654 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 884655 T2344 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 884655 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 884655 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 884660 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 884663 T2304 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52328",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52328_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 884663 T2304 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 884663 T2304 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 884670 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 884777 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 884781 T2343 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 884782 T2325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 884783 T2312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 885656 T2344 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 885657 T2344 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1391606910005/collection1
[junit4] 2> 885657 T2344 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 885659 T2344 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 885659 T2344 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 885662 T2344 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1391606910005/collection1/'
[junit4] 2> 885664 T2344 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1391606910005/collection1/lib/classes/' to classloader
[junit4] 2> 885664 T2344 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1391606910005/collection1/lib/README' to classloader
[junit4] 2> 885736 T2344 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 885806 T2344 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 885809 T2344 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 885823 T2344 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 886499 T2344 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 886507 T2344 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 886512 T2344 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 886535 T2344 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 886542 T2344 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 886546 T2344 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 886549 T2344 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 886549 T2344 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 886550 T2344 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 886552 T2344 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 886552 T2344 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 886552 T2344 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 886552 T2344 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.BasicDistributedZkTest-jetty2-1391606910005/collection1/, dataDir=./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/jetty2/
[junit4] 2> 886553 T2344 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@31e4f220
[junit4] 2> 886553 T2344 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/jetty2
[junit4] 2> 886553 T2344 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/jetty2/index/
[junit4] 2> 886553 T2344 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 886555 T2344 oasc.CachingDirectoryFactory.get return new directory for ./org.apache.solr.cloud.BasicDistributedZkTest-1391606902823/jetty2/index
[junit4] 2> 886555 T2344 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=2.0576171875, floorSegmentMB=1.3798828125, forceMergeDeletesPctAllowed=17.48292297400321, segmentsPerTier=10.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7594127430991644
[junit4] 2> 886556 T2344 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1b5be997 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2177a68a),segFN=segments_1,generation=1}
[junit4] 2> 886556 T2344 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 886561 T2344 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 886561 T2344 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 886562 T2344 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 886562 T2344 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 886562 T2344 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 886563 T2344 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 886563 T2344 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 886563 T2344 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 886564 T2344 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 886564 T2344 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 886566 T2344 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 886566 T2344 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 886566 T2344 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 886567 T2344 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 886567 T2344 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 886568 T2344 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 886568 T2344 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 886579 T2344 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 886584 T2344 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 886584 T2344 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 886585 T2344 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=33, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 886586 T2344 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@1b5be997 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@2177a68a),segFN=segments_1,generation=1}
[junit4] 2> 886586 T2344 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 886586 T2344 oass.SolrIndexSearcher.<init> Opening Searcher@55f8f897 main
[junit4] 2> 886591 T2345 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@55f8f897 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 886594 T2344 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 886595 T2281 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 886596 T2281 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 886596 T2348 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52328 collection:collection1 shard:shard2
[junit4] 2> 886610 T2348 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
[junit4] 2> 886645 T2348 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
[junit4] 2> 886661 T2348 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 886662 T2348 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2436 name=collection1 org.apache.solr.core.SolrCore@36380a04 url=http://127.0.0.1:52328/collection1 node=127.0.0.1:52328_ C2436_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:52328, core=collection1, node_name=127.0.0.1:52328_}
[junit4] 2> 886662 T2348 C2436 P52328 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52328/collection1/
[junit4] 2> 886662 T2348 C2436 P52328 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 886662 T2348 C2436 P52328 oasc.SyncStrategy.syncToMe http://127.0.0.1:52328/collection1/ has no replicas
[junit4] 2> 886662 T2348 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52328/collection1/ shard2
[junit4] 2> 886663 T2348 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
[junit4] 2> 886670 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 886670 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 886670 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 886682 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 886683 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 886696 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 886696 T2343 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 886697 T2325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 886697 T2312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 886710 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 886718 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 886824 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 886825 T2312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 886825 T2325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 886825 T2343 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 886839 T2348 oasc.ZkController.register We are http://127.0.0.1:52328/collection1/ and leader is http://127.0.0.1:52328/collection1/
[junit4] 2> 886839 T2348 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52328
[junit4] 2> 886839 T2348 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 886839 T2348 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 886840 T2348 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 886842 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 886842 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 886843 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 886844 T2348 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 886848 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 886850 T2304 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:52328",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52328_",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 886857 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 886973 T2325 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 886974 T2312 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 886975 T2343 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 886977 T2303 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 887078 T2281 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 887079 T2281 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 887083 T2281 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:52331
[junit4] 2> 887084 T2281 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 887085 T2281 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 887085 T2281 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1391606913632
[junit4] 2> 887085 T2281 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1391606913632/'
[junit4] 2> 887121 T2281 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1391606913632/solr.xml
[junit4] 2> 887243 T2281 oasc.CoreContainer.<init> New CoreContainer 610384027
[junit4] 2> 887243 T2281 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.BasicDistributedZkTest-jetty3-1391606913632/]
[junit4] 2> 887245 T2281 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 887246 T2281 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 887247 T2281 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 887248 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 887248 T2281 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 887248 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 887249 T2281 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 887249 T2281 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 887250 T2281 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 887264 T2281 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 887264 T2281 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 887265 T2281 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 887266 T2281 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:52318/solr
[junit4] 2> 887266 T2281 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 887268 T2281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 887275 T2359 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b9edac6 name:ZooKeeperConnection Watcher:127.0.0.1:52318 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 887276 T2281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 887281 T2281 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 887287 T2361 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a946aac name:ZooKeeperConnection Watcher:127.0.0.1:52318/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 887288 T2281 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 887298 T2281 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 888308 T2281 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52331_
[junit4] 2> 888311 T2281 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52331_
[junit4] 2> 888321 T2303 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 888323 T2325 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 888323 T2343 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 888323 T2312 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 888324 T2361 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 888346 T2362 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 888346 T2362 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 888349 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 888350 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 888350 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 888351 T2362 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 888356 T2304 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 888357 T2304 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:52331",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:52331_",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"2",
[junit4] 2> "core_node_name":null}
[junit4] 2> 888358 T2304 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
[junit4] 2> 888358 T2304 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 888365 T2303 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 888475 T2343 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 888476 T2361 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 4)
[junit4] 2> 888476 T
[...truncated too long message...]
ession expired for /overseer_elect/election
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:253)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:92)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> NOTE: test params are: codec=Lucene45, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=es_CL, timezone=SST
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=9,free=161377480,total=519438336
[junit4] 2> NOTE: All tests run in this JVM: [XmlUpdateRequestHandlerTest, MoreLikeThisHandlerTest, DeleteReplicaTest, QueryElevationComponentTest, CursorMarkTest, PreAnalyzedFieldTest, HighlighterConfigTest, ClusterStateUpdateTest, ResponseLogComponentTest, QueryParsingTest, CursorPagingTest, BadIndexSchemaTest, SearchHandlerTest, TestCollapseQParserPlugin, TestFileDictionaryLookup, TestClassNameShortening, TestSolrDeletionPolicy1, TermVectorComponentTest, TestBinaryResponseWriter, TestJoin, SuggesterTSTTest, IndexSchemaTest, ClusterStateTest, TestDocBasedVersionConstraints, TestDefaultSimilarityFactory, TestGroupingSearch, DocumentAnalysisRequestHandlerTest, ZkControllerTest, TestImplicitCoreProperties, DocValuesTest, DocumentBuilderTest, OpenExchangeRatesOrgProviderTest, TestFoldingMultitermQuery, TestSchemaNameResource, ZkCLITest, PolyFieldTest, TestSolrXml, TestCursorMarkWithoutUniqueKey, OutputWriterTest, RecoveryZkTest, TestSolrQueryParser, UpdateParamsTest, TestCollationField, XsltUpdateRequestHandlerTest, ExternalFileFieldSortTest, TestLuceneMatchVersion, TestStressUserVersions, PeerSyncTest, TestRecovery, StatelessScriptUpdateProcessorFactoryTest, TestAnalyzeInfixSuggestions, PathHierarchyTokenizerFactoryTest, PluginInfoTest, AddSchemaFieldsUpdateProcessorFactoryTest, AnalysisErrorHandlingTest, BadCopyFieldTest, EnumFieldTest, TestCharFilters, SolrCoreCheckLockOnStartupTest, TestXIncludeConfig, BlockCacheTest, SimpleFacetsTest, TestInitQParser, ZkSolrClientTest, SuggestComponentTest, TestFieldTypeCollectionResource, TestPhraseSuggestions, TestSolr4Spatial, LukeRequestHandlerTest, MultiTermTest, SolrIndexSplitterTest, DirectUpdateHandlerTest, TestSolrIndexConfig, TestOmitPositions, HighlighterTest, ReturnFieldsTest, FileUtilsTest, DateMathParserTest, MinimalSchemaTest, TestUniqueKeyFieldResource, UniqFieldsUpdateProcessorFactoryTest, TestArbitraryIndexDir, DistribCursorPagingTest, ChangedSchemaMergeTest, TestBM25SimilarityFactory, HdfsDirectoryTest, CoreMergeIndexesAdminHandlerTest, TestLMJelinekMercerSimilarityFactory, SampleTest, CustomCollectionTest, TestAddFieldRealTimeGet, StatsComponentTest, TestExtendedDismaxParser, ShowFileRequestHandlerTest, TestFieldTypeResource, TestDefaultSearchFieldResource, TestElisionMultitermQuery, TestFuzzyAnalyzedSuggestions, UpdateRequestProcessorFactoryTest, TestLMDirichletSimilarityFactory, TestSolrDeletionPolicy2, HdfsBasicDistributedZk2Test, BasicFunctionalityTest, TestSolrCoreProperties, FileBasedSpellCheckerTest, TestCollationFieldDocValues, RequiredFieldsTest, TestPseudoReturnFields, TestSolrQueryParserResource, TestDistributedGrouping, TimeZoneUtilsTest, TestRemoteStreaming, TestDistributedMissingSort, TestSolrQueryParserDefaultOperatorResource, FieldFacetExtrasTest, DirectSolrConnectionTest, TestRTGBase, DistributedDebugComponentTest, TestFastLRUCache, QueryFacetTest, PingRequestHandlerTest, TestQueryTypes, ScriptEngineTest, TestRealTimeGet, BasicDistributedZkTest, LeaderElectionTest, TestCoreContainer, ZkNodePropsTest, TestCustomSort, TestInfoStreamLogging, TestCSVLoader, TestNRTOpen, AlternateDirectoryTest, AbstractAnalyticsFacetTest, CoreAdminHandlerTest, TestRandomDVFaceting, SpellPossibilityIteratorTest, TestPerFieldSimilarity, AutoCommitTest, FastVectorHighlighterTest, DOMUtilTest, TestCSVResponseWriter, TestHighFrequencyDictionaryFactory, InfoHandlerTest, TestDynamicFieldResource, TestStressRecovery, TestRecoveryHdfs, SolrInfoMBeanTest, TestIBSimilarityFactory, TestFastWriter, PreAnalyzedUpdateProcessorTest, TestSerializedLuceneMatchVersion, QueryEqualityTest, SimplePostToolTest, BasicZkTest, TestWriterPerf, TestCoreDiscovery, SolrPluginUtilsTest, HdfsCollectionsAPIDistributedZkTest, SchemaVersionSpecificBehaviorTest, TestSearchPerf, TestRangeQuery, BasicDistributedZk2Test, TestTrie, TestPostingsSolrHighlighter, SystemInfoHandlerTest, CacheHeaderTest, TestStressReorder, TestManagedSchemaFieldResource, TestConfig, SyncSliceTest, TestFaceting, TestAtomicUpdateErrorCases, TestModifyConfFiles, SliceStateUpdateTest, JSONWriterTest, SpellingQueryConverterTest, TestDistribDocBasedVersion, LegacyHTMLStripCharFilterTest, TestFreeTextSuggestions, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, TestReplicationHandler, TestRandomFaceting, TestZkChroot, ShardRoutingCustomTest, TestDistributedSearch, TestHashPartitioner, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestMultiCoreConfBootstrap, TestReload, TestStressVersions, HardAutoCommitTest, DistributedTermsComponentTest, SolrCoreTest, SpellCheckComponentTest, SolrCmdDistributorTest, ConvertedLegacyTest, TestSort, TestFiltering, TestFunctionQuery, TestLazyCores, TestBadConfig, OverseerCollectionProcessorTest, TestIndexSearcher, SoftAutoCommitTest, CurrencyFieldOpenExchangeTest, DistributedQueryElevationComponentTest, CurrencyFieldXmlFileTest, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, SuggesterFSTTest, SolrRequestParserTest, SuggesterTest, TestStressLucene, SpatialFilterTest, SuggesterWFSTTest, NoCacheHeaderTest, WordBreakSolrSpellCheckerTest, TestUpdate, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, SortByFunctionTest, DocValuesMultiTest, DistanceFunctionTest, DebugComponentTest, IndexBasedSpellCheckerTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestQueryUtils, StandardRequestHandlerTest, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, PrimitiveFieldTypeTest, TermsComponentTest, RequestHandlersTest, TestValueSourceCache, TestIndexingPerformance, FieldAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, RegexBoostProcessorTest, TestJmxIntegration, MBeansHandlerTest, TestAnalyzedSuggestions, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestComponentsName, CoreContainerCoreInitFailuresTest, TestLFUCache, SOLR749Test, TestQuerySenderListener, TestQuerySenderNoQuery, CopyFieldTest, SolrIndexConfigTest, BadComponentTest, TestMergePolicyConfig, TestDocSet, TestBinaryField, NumericFieldsTest, NotRequiredUniqueKeyTest, TestCodecSupport, SynonymTokenizerTest, EchoParamsTest, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestNumberUtils, TestJmxMonitoredMap, ResourceLoaderTest, TestFastOutputStream, URLClassifyProcessorTest, ChaosMonkeyNothingIsSafeTest, TestSolrXMLSerializer, TestSystemIdResolver, PrimUtilsTest, TestSuggestSpellingConverter, DateFieldTest, RAMDirectoryFactoryTest, TestSolrJ, TestLRUCache, TestUtils, TestDocumentBuilder, SliceStateTest, UUIDFieldTest, CircularListTest, SolrTestCaseJ4Test, AbstractAnalyticsStatsTest, NoFacetTest, ExpressionTest, RangeFacetTest, FunctionTest, AliasIntegrationTest, AssignTest, ConnectionManagerTest, DeleteShardTest, MigrateRouteKeyTest, OverseerRolesTest]
[junit4] Completed in 26.82s, 1 test, 1 error <<< FAILURES!
[...truncated 141 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:453: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:433: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1268: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:901: There were test failures: 368 suites, 1593 tests, 1 error, 1 failure, 46 ignored (6 assumptions)
Total time: 87 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1300
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1300/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC
2 tests failed.
REGRESSION: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.testDistribSearch
Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:56723/obkt/cy/collection1, http://127.0.0.1:56707/obkt/cy/collection1, http://127.0.0.1:56710/obkt/cy/collection1, http://127.0.0.1:56750/obkt/cy/collection1, http://127.0.0.1:56730/obkt/cy/collection1, http://127.0.0.1:56713/obkt/cy/collection1, http://127.0.0.1:56704/obkt/cy/collection1]
Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:56723/obkt/cy/collection1, http://127.0.0.1:56707/obkt/cy/collection1, http://127.0.0.1:56710/obkt/cy/collection1, http://127.0.0.1:56750/obkt/cy/collection1, http://127.0.0.1:56730/obkt/cy/collection1, http://127.0.0.1:56713/obkt/cy/collection1, http://127.0.0.1:56704/obkt/cy/collection1]
at __randomizedtesting.SeedInfo.seed([31B9FA70D40E72C2:B05F7468A35112FE]:0)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:352)
at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:640)
at org.apache.solr.client.solrj.request.QueryRequest.process(QueryRequest.java:90)
at org.apache.solr.client.solrj.SolrServer.query(SolrServer.java:301)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.checkShardConsistency(AbstractFullDistribZkTestBase.java:1170)
at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.doTest(ChaosMonkeySafeLeaderTest.java:149)
at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:867)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1559)
at com.carrotsearch.randomizedtesting.RandomizedRunner.access$600(RandomizedRunner.java:79)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:773)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:787)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
at org.apache.lucene.util.TestRuleFieldCacheSanity$1.evaluate(TestRuleFieldCacheSanity.java:51)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:782)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:442)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:746)
at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:648)
at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:682)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:693)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:70)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:358)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: http://127.0.0.1:56707/obkt/cy/collection1
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:495)
at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:199)
at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:283)
... 46 more
FAILED: org.apache.solr.cloud.OverseerRolesTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=10904, name=Overseer-91203500347490320-127.0.0.1:58469_-n_0000000006, state=RUNNABLE, group=Overseer collection creation process.]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10904, name=Overseer-91203500347490320-127.0.0.1:58469_-n_0000000006, state=RUNNABLE, group=Overseer collection creation process.]
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
at __randomizedtesting.SeedInfo.seed([31B9FA70D40E72C2]:0)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:209)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qnr-0000000004
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.setData(ZooKeeper.java:1266)
at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:290)
at org.apache.solr.common.cloud.SolrZkClient$8.execute(SolrZkClient.java:287)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:287)
at org.apache.solr.common.cloud.SolrZkClient.setData(SolrZkClient.java:473)
at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:190)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
... 1 more
Build Log:
[...truncated 10340 lines...]
[junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
[junit4] 2> 1526970 T5525 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /obkt/cy
[junit4] 2> 1526975 T5525 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-ChaosMonkeySafeLeaderTest-1391653578758
[junit4] 2> 1526976 T5525 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1526977 T5526 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1527077 T5525 oasc.ZkTestServer.run start zk server on port:56697
[junit4] 2> 1527079 T5525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1527091 T5532 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@303d88f2 name:ZooKeeperConnection Watcher:127.0.0.1:56697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1527092 T5525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1527093 T5525 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1527113 T5525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1527121 T5534 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@62416326 name:ZooKeeperConnection Watcher:127.0.0.1:56697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1527122 T5525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1527123 T5525 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1527138 T5525 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1527153 T5525 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1527165 T5525 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1527179 T5525 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1527180 T5525 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1527201 T5525 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1527202 T5525 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1527217 T5525 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1527218 T5525 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1527234 T5525 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1527235 T5525 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1527251 T5525 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1527252 T5525 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1527267 T5525 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1527268 T5525 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1527284 T5525 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1527285 T5525 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1527303 T5525 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1527304 T5525 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1527319 T5525 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1527320 T5525 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1527335 T5525 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1527335 T5525 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1527351 T5525 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1527352 T5525 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1527771 T5525 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1527776 T5525 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56700
[junit4] 2> 1527777 T5525 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1527777 T5525 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1527778 T5525 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391653579156
[junit4] 2> 1527778 T5525 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391653579156/'
[junit4] 2> 1527809 T5525 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391653579156/solr.xml
[junit4] 2> 1527887 T5525 oasc.CoreContainer.<init> New CoreContainer 1000676151
[junit4] 2> 1527887 T5525 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391653579156/]
[junit4] 2> 1527889 T5525 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1527889 T5525 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1527890 T5525 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1527890 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1527891 T5525 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1527891 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1527891 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1527891 T5525 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1527891 T5525 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1527901 T5525 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1527901 T5525 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1527901 T5525 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1527902 T5525 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56697/solr
[junit4] 2> 1527902 T5525 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1527903 T5525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1527908 T5545 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@549dd678 name:ZooKeeperConnection Watcher:127.0.0.1:56697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1527909 T5525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1527914 T5525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1527917 T5547 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d11f864 name:ZooKeeperConnection Watcher:127.0.0.1:56697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1527918 T5525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1527921 T5525 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1527929 T5525 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1527938 T5525 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1527943 T5525 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56700_obkt%2Fcy
[junit4] 2> 1527945 T5525 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56700_obkt%2Fcy
[junit4] 2> 1527953 T5525 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1527960 T5525 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1527974 T5525 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:56700_obkt%2Fcy
[junit4] 2> 1527975 T5525 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1527983 T5525 oasc.Overseer.start Overseer (id=91203408937943043-127.0.0.1:56700_obkt%2Fcy-n_0000000000) starting
[junit4] 2> 1527995 T5525 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1528011 T5549 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1528013 T5525 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1528016 T5549 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 1528026 T5525 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1528035 T5525 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1528052 T5548 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1528071 T5550 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1528072 T5550 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1528077 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1528077 T5550 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1528086 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1528088 T5548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56700/obkt/cy",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56700_obkt%2Fcy",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"1",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1528089 T5548 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
[junit4] 2> 1528089 T5548 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1528102 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1528106 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1529079 T5550 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1529079 T5550 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391653579156/collection1
[junit4] 2> 1529080 T5550 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
[junit4] 2> 1529083 T5550 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1529084 T5550 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
[junit4] 2> 1529088 T5550 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391653579156/collection1/'
[junit4] 2> 1529090 T5550 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391653579156/collection1/lib/classes/' to classloader
[junit4] 2> 1529091 T5550 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391653579156/collection1/lib/README' to classloader
[junit4] 2> 1529168 T5550 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1529221 T5550 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1529226 T5550 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1529232 T5550 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1529673 T5550 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1529676 T5550 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1529678 T5550 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1529684 T5550 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1529746 T5550 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1529747 T5550 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-controljetty-1391653579156/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/control/data/
[junit4] 2> 1529747 T5550 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8961606
[junit4] 2> 1529748 T5550 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/control/data
[junit4] 2> 1529748 T5550 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/control/data/index/
[junit4] 2> 1529749 T5550 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/control/data/index' doesn't exist. Creating new index...
[junit4] 2> 1529751 T5550 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/control/data/index
[junit4] 2> 1529751 T5550 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=15.3486328125, floorSegmentMB=0.3076171875, forceMergeDeletesPctAllowed=25.64066181489555, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1529756 T5550 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1529756 T5550 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1529760 T5550 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1529760 T5550 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1529761 T5550 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1529761 T5550 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1529761 T5550 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1529762 T5550 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1529762 T5550 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1529763 T5550 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1529763 T5550 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1529764 T5550 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1529764 T5550 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1529765 T5550 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1529765 T5550 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1529766 T5550 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1529766 T5550 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1529767 T5550 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1529768 T5550 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1529777 T5550 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1529781 T5550 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1529781 T5550 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1529781 T5550 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7467173419967159]
[junit4] 2> 1529783 T5550 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/control/data/index,segFN=segments_1,generation=1}
[junit4] 2> 1529783 T5550 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1529783 T5550 oass.SolrIndexSearcher.<init> Opening Searcher@2a174ddc main
[junit4] 2> 1529786 T5551 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a174ddc main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1529787 T5550 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1529789 T5525 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1529789 T5554 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56700/obkt/cy collection:control_collection shard:shard1
[junit4] 2> 1529790 T5525 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1529792 T5525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1529796 T5556 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7469489b name:ZooKeeperConnection Watcher:127.0.0.1:56697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1529796 T5554 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
[junit4] 2> 1529797 T5525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1529800 T5525 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1529807 T5525 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1529814 T5554 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1529818 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1529819 T5554 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1529819 T5554 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2369 name=collection1 org.apache.solr.core.SolrCore@4e337ee5 url=http://127.0.0.1:56700/obkt/cy/collection1 node=127.0.0.1:56700_obkt%2Fcy C2369_STATE=coll:control_collection core:collection1 props:{state=down, base_url=http://127.0.0.1:56700/obkt/cy, core=collection1, node_name=127.0.0.1:56700_obkt%2Fcy}
[junit4] 2> 1529819 T5554 C2369 P56700 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56700/obkt/cy/collection1/
[junit4] 2> 1529820 T5554 C2369 P56700 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1529820 T5554 C2369 P56700 oasc.SyncStrategy.syncToMe http://127.0.0.1:56700/obkt/cy/collection1/ has no replicas
[junit4] 2> 1529820 T5554 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56700/obkt/cy/collection1/ shard1
[junit4] 2> 1529820 T5554 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
[junit4] 2> 1529830 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1529838 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1529842 T5556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1529842 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1529850 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1529857 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1529968 T5556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1529971 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1529993 T5554 oasc.ZkController.register We are http://127.0.0.1:56700/obkt/cy/collection1/ and leader is http://127.0.0.1:56700/obkt/cy/collection1/
[junit4] 2> 1529993 T5554 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56700/obkt/cy
[junit4] 2> 1529993 T5554 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1529993 T5554 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1529994 T5554 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1529996 T5554 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1529997 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1529998 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1529998 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1530000 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1530001 T5548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:56700/obkt/cy",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56700_obkt%2Fcy",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"control_collection",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1530005 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1530111 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1530114 T5556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
[junit4] 2> 1530132 T5525 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1530133 T5525 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1530137 T5525 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56704
[junit4] 2> 1530137 T5525 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1530138 T5525 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1530138 T5525 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391653581591
[junit4] 2> 1530138 T5525 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391653581591/'
[junit4] 2> 1530170 T5525 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391653581591/solr.xml
[junit4] 2> 1530242 T5525 oasc.CoreContainer.<init> New CoreContainer 1075473390
[junit4] 2> 1530243 T5525 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391653581591/]
[junit4] 2> 1530244 T5525 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1530244 T5525 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1530244 T5525 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1530245 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1530245 T5525 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1530245 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1530245 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1530245 T5525 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1530246 T5525 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1530255 T5525 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1530255 T5525 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1530255 T5525 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1530256 T5525 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56697/solr
[junit4] 2> 1530256 T5525 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1530257 T5525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1530261 T5567 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6a3f723 name:ZooKeeperConnection Watcher:127.0.0.1:56697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1530263 T5525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1530269 T5525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1530272 T5569 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3404e2ef name:ZooKeeperConnection Watcher:127.0.0.1:56697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1530273 T5525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1530284 T5525 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1531294 T5525 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56704_obkt%2Fcy
[junit4] 2> 1531299 T5525 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56704_obkt%2Fcy
[junit4] 2> 1531315 T5556 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1531316 T5547 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1531316 T5569 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1531337 T5570 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1531337 T5570 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1531340 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1531340 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1531340 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1531340 T5570 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1531345 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1531347 T5548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56704/obkt/cy",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56704_obkt%2Fcy",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1531347 T5548 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2, shard3]
[junit4] 2> 1531347 T5548 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard3
[junit4] 2> 1531355 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1531465 T5556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1531466 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1531466 T5569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1532343 T5570 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1532343 T5570 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391653581591/collection1
[junit4] 2> 1532343 T5570 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1532347 T5570 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1532347 T5570 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1532353 T5570 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391653581591/collection1/'
[junit4] 2> 1532356 T5570 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391653581591/collection1/lib/classes/' to classloader
[junit4] 2> 1532357 T5570 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391653581591/collection1/lib/README' to classloader
[junit4] 2> 1532433 T5570 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1532502 T5570 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1532505 T5570 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1532513 T5570 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1532964 T5570 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1532970 T5570 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1532971 T5570 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1532979 T5570 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1533041 T5570 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1533041 T5570 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty1-1391653581591/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty1/
[junit4] 2> 1533042 T5570 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8961606
[junit4] 2> 1533043 T5570 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty1
[junit4] 2> 1533043 T5570 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty1/index/
[junit4] 2> 1533044 T5570 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty1/index' doesn't exist. Creating new index...
[junit4] 2> 1533046 T5570 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty1/index
[junit4] 2> 1533046 T5570 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=15.3486328125, floorSegmentMB=0.3076171875, forceMergeDeletesPctAllowed=25.64066181489555, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1533050 T5570 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 1533050 T5570 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1533054 T5570 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1533055 T5570 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1533055 T5570 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1533055 T5570 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1533055 T5570 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1533056 T5570 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1533056 T5570 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1533057 T5570 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1533057 T5570 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1533058 T5570 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1533059 T5570 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1533059 T5570 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1533059 T5570 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1533060 T5570 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1533061 T5570 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1533061 T5570 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1533062 T5570 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1533082 T5570 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1533089 T5570 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1533089 T5570 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1533091 T5570 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7467173419967159]
[junit4] 2> 1533093 T5570 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty1/index,segFN=segments_1,generation=1}
[junit4] 2> 1533094 T5570 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1533095 T5570 oass.SolrIndexSearcher.<init> Opening Searcher@5fcb09e7 main
[junit4] 2> 1533111 T5571 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@5fcb09e7 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1533117 T5570 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1533120 T5525 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1533120 T5574 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56704/obkt/cy collection:collection1 shard:shard3
[junit4] 2> 1533120 T5525 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1533125 T5574 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard3/election
[junit4] 2> 1533151 T5574 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 1533156 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1533156 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1533156 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1533158 T5574 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1533158 T5574 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2370 name=collection1 org.apache.solr.core.SolrCore@46f3a261 url=http://127.0.0.1:56704/obkt/cy/collection1 node=127.0.0.1:56704_obkt%2Fcy C2370_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:56704/obkt/cy, core=collection1, node_name=127.0.0.1:56704_obkt%2Fcy}
[junit4] 2> 1533158 T5574 C2370 P56704 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56704/obkt/cy/collection1/
[junit4] 2> 1533158 T5574 C2370 P56704 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1533159 T5574 C2370 P56704 oasc.SyncStrategy.syncToMe http://127.0.0.1:56704/obkt/cy/collection1/ has no replicas
[junit4] 2> 1533159 T5574 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56704/obkt/cy/collection1/ shard3
[junit4] 2> 1533160 T5574 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard3
[junit4] 2> 1533159 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1533167 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1533169 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1533169 T5556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1533171 T5569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1533178 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1533181 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1533188 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1533293 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1533293 T5569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1533293 T5556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1533335 T5574 oasc.ZkController.register We are http://127.0.0.1:56704/obkt/cy/collection1/ and leader is http://127.0.0.1:56704/obkt/cy/collection1/
[junit4] 2> 1533336 T5574 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56704/obkt/cy
[junit4] 2> 1533336 T5574 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1533336 T5574 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1533336 T5574 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1533338 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1533338 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1533339 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1533340 T5574 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1533343 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1533344 T5548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:56704/obkt/cy",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56704_obkt%2Fcy",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node1"}
[junit4] 2> 1533350 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1533455 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1533455 T5569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1533455 T5556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
[junit4] 2> 1533534 T5525 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1533535 T5525 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1533539 T5525 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56707
[junit4] 2> 1533540 T5525 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1533540 T5525 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1533541 T5525 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391653584906
[junit4] 2> 1533541 T5525 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391653584906/'
[junit4] 2> 1533571 T5525 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391653584906/solr.xml
[junit4] 2> 1533655 T5525 oasc.CoreContainer.<init> New CoreContainer 1513898736
[junit4] 2> 1533655 T5525 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391653584906/]
[junit4] 2> 1533657 T5525 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1533657 T5525 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1533657 T5525 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1533657 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1533658 T5525 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1533658 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1533658 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1533658 T5525 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1533659 T5525 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1533668 T5525 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1533668 T5525 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1533668 T5525 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1533668 T5525 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56697/solr
[junit4] 2> 1533669 T5525 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1533670 T5525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1533674 T5585 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2a4ec8d8 name:ZooKeeperConnection Watcher:127.0.0.1:56697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1533675 T5525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1533681 T5525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1533685 T5587 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b4388a9 name:ZooKeeperConnection Watcher:127.0.0.1:56697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1533686 T5525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1533698 T5525 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1534708 T5525 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56707_obkt%2Fcy
[junit4] 2> 1534711 T5525 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56707_obkt%2Fcy
[junit4] 2> 1534726 T5569 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1534727 T5556 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1534726 T5587 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1534728 T5547 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1534756 T5588 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1534757 T5588 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1534761 T5588 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1534761 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1534762 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1534762 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1534771 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1534774 T5548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56707/obkt/cy",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56707_obkt%2Fcy",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1534774 T5548 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1534775 T5548 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
[junit4] 2> 1534787 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1534898 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1534899 T5587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1534899 T5569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1534899 T5556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1535763 T5588 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
[junit4] 2> 1535763 T5588 oasc.CoreContainer.create Creating SolrCore 'collection1' using instanceDir: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391653584906/collection1
[junit4] 2> 1535764 T5588 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
[junit4] 2> 1535767 T5588 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1535768 T5588 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
[junit4] 2> 1535774 T5588 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391653584906/collection1/'
[junit4] 2> 1535777 T5588 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391653584906/collection1/lib/classes/' to classloader
[junit4] 2> 1535778 T5588 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391653584906/collection1/lib/README' to classloader
[junit4] 2> 1535867 T5588 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1535927 T5588 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1535931 T5588 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1535945 T5588 oass.IndexSchema.readSchema [collection1] Schema name=test
[junit4] 2> 1536418 T5588 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1536421 T5588 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1536423 T5588 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1536430 T5588 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1536532 T5588 oasc.SolrCore.initDirectoryFactory solr.StandardDirectoryFactory
[junit4] 2> 1536533 T5588 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty2-1391653584906/collection1/, dataDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty2/
[junit4] 2> 1536534 T5588 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@8961606
[junit4] 2> 1536535 T5588 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty2
[junit4] 2> 1536536 T5588 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty2/index/
[junit4] 2> 1536537 T5588 oasc.SolrCore.initIndex WARN [collection1] Solr index directory './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty2/index' doesn't exist. Creating new index...
[junit4] 2> 1536539 T5588 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty2/index
[junit4] 2> 1536540 T5588 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=36, maxMergeAtOnceExplicit=28, maxMergedSegmentMB=15.3486328125, floorSegmentMB=0.3076171875, forceMergeDeletesPctAllowed=25.64066181489555, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1536546 T5588 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 1536547 T5588 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1536555 T5588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1536556 T5588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1536558 T5588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1536558 T5588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1536558 T5588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1536559 T5588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1536560 T5588 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1536561 T5588 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1536561 T5588 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1536563 T5588 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1536565 T5588 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1536565 T5588 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1536566 T5588 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1536567 T5588 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1536568 T5588 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1536569 T5588 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1536569 T5588 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1536578 T5588 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1536581 T5588 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1536582 T5588 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1536582 T5588 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=30, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7467173419967159]
[junit4] 2> 1536583 T5588 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-1391653578758/jetty2/index,segFN=segments_1,generation=1}
[junit4] 2> 1536584 T5588 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1536584 T5588 oass.SolrIndexSearcher.<init> Opening Searcher@2ac0d48b main
[junit4] 2> 1536587 T5589 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2ac0d48b main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1536592 T5588 oasc.CoreContainer.registerCore registering core: collection1
[junit4] 2> 1536594 T5525 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1536594 T5592 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:56707/obkt/cy collection:collection1 shard:shard1
[junit4] 2> 1536594 T5525 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1536596 T5592 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
[junit4] 2> 1536606 T5592 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
[junit4] 2> 1536611 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1536611 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1536612 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1536615 T5592 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
[junit4] 2> 1536615 T5592 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
[junit4] 2> ASYNC NEW_CORE C2371 name=collection1 org.apache.solr.core.SolrCore@17954803 url=http://127.0.0.1:56707/obkt/cy/collection1 node=127.0.0.1:56707_obkt%2Fcy C2371_STATE=coll:collection1 core:collection1 props:{state=down, base_url=http://127.0.0.1:56707/obkt/cy, core=collection1, node_name=127.0.0.1:56707_obkt%2Fcy}
[junit4] 2> 1536615 T5592 C2371 P56707 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:56707/obkt/cy/collection1/
[junit4] 2> 1536616 T5592 C2371 P56707 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
[junit4] 2> 1536616 T5592 C2371 P56707 oasc.SyncStrategy.syncToMe http://127.0.0.1:56707/obkt/cy/collection1/ has no replicas
[junit4] 2> 1536616 T5592 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:56707/obkt/cy/collection1/ shard1
[junit4] 2> 1536617 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1536617 T5592 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
[junit4] 2> 1536626 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1536629 T5569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536630 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536631 T5556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536632 T5587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536640 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1536642 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1536648 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1536754 T5556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536754 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536754 T5569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536755 T5587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536802 T5592 oasc.ZkController.register We are http://127.0.0.1:56707/obkt/cy/collection1/ and leader is http://127.0.0.1:56707/obkt/cy/collection1/
[junit4] 2> 1536803 T5592 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:56707/obkt/cy
[junit4] 2> 1536803 T5592 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
[junit4] 2> 1536803 T5592 oasc.ZkController.publish publishing core=collection1 state=active
[junit4] 2> 1536803 T5592 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1536805 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1536805 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1536805 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1536807 T5592 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1536809 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1536811 T5548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"active",
[junit4] 2> "base_url":"http://127.0.0.1:56707/obkt/cy",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56707_obkt%2Fcy",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":"core_node2"}
[junit4] 2> 1536816 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1536922 T5556 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536923 T5587 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536923 T5569 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536923 T5547 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
[junit4] 2> 1536951 T5525 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1536951 T5525 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1536955 T5525 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:56710
[junit4] 2> 1536957 T5525 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1536957 T5525 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1536958 T5525 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391653588378
[junit4] 2> 1536958 T5525 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391653588378/'
[junit4] 2> 1536989 T5525 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391653588378/solr.xml
[junit4] 2> 1537071 T5525 oasc.CoreContainer.<init> New CoreContainer 1703380435
[junit4] 2> 1537072 T5525 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.ChaosMonkeySafeLeaderTest-jetty3-1391653588378/]
[junit4] 2> 1537073 T5525 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1537074 T5525 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1537074 T5525 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1537074 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1537074 T5525 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1537075 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1537075 T5525 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1537075 T5525 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1537075 T5525 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1537097 T5525 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1537097 T5525 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1537097 T5525 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1537098 T5525 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:56697/solr
[junit4] 2> 1537099 T5525 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1537100 T5525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1537104 T5603 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@246313b8 name:ZooKeeperConnection Watcher:127.0.0.1:56697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1537106 T5525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1537110 T5525 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1537113 T5605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@56eca3ee name:ZooKeeperConnection Watcher:127.0.0.1:56697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1537114 T5525 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1537124 T5525 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1538135 T5525 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:56710_obkt%2Fcy
[junit4] 2> 1538139 T5525 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:56710_obkt%2Fcy
[junit4] 2> 1538156 T5547 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1538156 T5556 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1538156 T5569 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1538157 T5587 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1538158 T5605 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1539007 T5606 oasc.ZkController.publish publishing core=collection1 state=down
[junit4] 2> 1539008 T5606 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
[junit4] 2> 1539012 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1539013 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1539013 T5547 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1539013 T5606 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1539021 T5548 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1539024 T5548 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=3 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:56710/obkt/cy",
[junit4] 2> "core":"collection1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:56710_obkt%2Fcy",
[junit4] 2> "shard":null,
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"collection1",
[junit4] 2> "numShards":"3",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1539025 T5548 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=3
[junit4] 2> 1539025 T5548 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
[junit4] 2> 1539038 T5547 oasc.DistributedQueue$LatchChildWatcher.
[...truncated too long message...]
ava:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 2946757 T10857 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 2946757 T10857 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2946757 T10857 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2946757 T10857 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2946758 T10857 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 2946758 T10857 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> NOTE: test params are: codec=Lucene41, sim=DefaultSimilarity, locale=pt, timezone=CTT
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=1,free=232930488,total=460324864
[junit4] 2> NOTE: All tests run in this JVM: [AlternateDirectoryTest, ConnectionManagerTest, BasicDistributedZkTest, TestStressUserVersions, TestFastLRUCache, HdfsLockFactoryTest, DocumentAnalysisRequestHandlerTest, TestFieldCollectionResource, ClusterStateUpdateTest, TestLazyCores, TestCSVLoader, QueryElevationComponentTest, TestUniqueKeyFieldResource, TestDistributedGrouping, CoreAdminCreateDiscoverTest, SignatureUpdateProcessorFactoryTest, TestSchemaSimilarityResource, TestQuerySenderListener, TestLFUCache, TestDistributedSearch, BJQParserTest, RequestHandlersTest, TestAnalyzeInfixSuggestions, AutoCommitTest, CoreMergeIndexesAdminHandlerTest, LukeRequestHandlerTest, TestShardHandlerFactory, PrimitiveFieldTypeTest, DirectUpdateHandlerOptimizeTest, FullSolrCloudDistribCmdsTest, SpatialFilterTest, AnalysisAfterCoreReloadTest, HdfsSyncSliceTest, LeaderElectionTest, TestInfoStreamLogging, ShardSplitTest, ResourceLoaderTest, HdfsChaosMonkeySafeLeaderTest, RequiredFieldsTest, DistributedSpellCheckComponentTest, TestSolrDeletionPolicy2, TestQueryUtils, SortByFunctionTest, TestStressRecovery, FileUtilsTest, TestLMJelinekMercerSimilarityFactory, URLClassifyProcessorTest, TestCustomSort, DocValuesTest, UpdateRequestProcessorFactoryTest, UpdateParamsTest, TestBinaryResponseWriter, NoCacheHeaderTest, PeerSyncTest, SolrTestCaseJ4Test, TestRecoveryHdfs, TestSolr4Spatial, LeaderElectionIntegrationTest, TestSchemaResource, DirectSolrSpellCheckerTest, CopyFieldTest, SynonymTokenizerTest, DebugComponentTest, SuggestComponentTest, BlockDirectoryTest, TestFreeTextSuggestions, RangeFacetTest, TestAtomicUpdateErrorCases, TestRandomFaceting, AddSchemaFieldsUpdateProcessorFactoryTest, TestManagedSchemaFieldResource, TestLRUCache, TestOmitPositions, SolrXmlInZkTest, SliceStateTest, TestSuggestSpellingConverter, ConvertedLegacyTest, TestStandardQParsers, TestJoin, TestPseudoReturnFields, SolrRequestParserTest, RAMDirectoryFactoryTest, ZkSolrClientTest, TestWordDelimiterFilterFactory, DocValuesMissingTest, TestSolrXMLSerializer, TestCodecSupport, TestCoreDiscovery, TestReload, PluginInfoTest, TestXIncludeConfig, StatsComponentTest, TestPhraseSuggestions, ExpressionTest, SuggesterTest, CoreContainerCoreInitFailuresTest, BinaryUpdateRequestHandlerTest, NoFacetTest, XsltUpdateRequestHandlerTest, MinimalSchemaTest, HdfsUnloadDistributedZkTest, TestStressVersions, SpellCheckComponentTest, SuggesterWFSTTest, QueryFacetTest, DeleteReplicaTest, TestDFRSimilarityFactory, SolrInfoMBeanTest, CustomCollectionTest, DistributedQueryElevationComponentTest, TestCollationField, TestSystemIdResolver, BlockCacheTest, TestSchemaVersionResource, DOMUtilTest, DefaultValueUpdateProcessorTest, TestExtendedDismaxParser, PathHierarchyTokenizerFactoryTest, TestSolrQueryParserDefaultOperatorResource, SolrIndexSplitterTest, CacheHeaderTest, ReturnFieldsTest, TestCursorMarkWithoutUniqueKey, TermsComponentTest, CachingDirectoryFactoryTest, TestDistribDocBasedVersion, TestBM25SimilarityFactory, TestCollapseQParserPlugin, TestDocSet, PingRequestHandlerTest, TestClassNameShortening, TestZkChroot, TriLevelCompositeIdRoutingTest, StandardRequestHandlerTest, ChangedSchemaMergeTest, TestCSVResponseWriter, PreAnalyzedUpdateProcessorTest, DirectSolrConnectionTest, IndexSchemaTest, NotRequiredUniqueKeyTest, TestFoldingMultitermQuery, CurrencyFieldXmlFileTest, TestCopyFieldCollectionResource, DistanceFunctionTest, TestFiltering, TestRealTimeGet, MBeansHandlerTest, CircularListTest, QueryParsingTest, TestBadConfig, FieldAnalysisRequestHandlerTest, PrimUtilsTest, SolrPluginUtilsTest, CoreAdminHandlerTest, TestSort, TestUtils, SolrCoreTest, StressHdfsTest, TestRTGBase, DistributedDebugComponentTest, SimpleFacetsTest, TestRemoteStreaming, AnalysisErrorHandlingTest, TestInitQParser, TestFastWriter, ChaosMonkeyNothingIsSafeTest, MigrateRouteKeyTest, ResponseLogComponentTest, QueryEqualityTest, TestSolrIndexConfig, TestLuceneMatchVersion, SoftAutoCommitTest, TestDynamicFieldCollectionResource, TestRandomDVFaceting, TestDocumentBuilder, LegacyHTMLStripCharFilterTest, TestRecovery, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, ShardRoutingTest, BasicZkTest, RecoveryZkTest, TestReplicationHandler, ZkCLITest, ShardRoutingCustomTest, SliceStateUpdateTest, TestFaceting, TestHashPartitioner, TermVectorComponentDistributedTest, ZkControllerTest, TestStressReorder, TestMultiCoreConfBootstrap, HardAutoCommitTest, DistributedTermsComponentTest, TestRangeQuery, TestCoreContainer, TestGroupingSearch, SolrCmdDistributorTest, BadIndexSchemaTest, TestFunctionQuery, BasicFunctionalityTest, DirectUpdateHandlerTest, OverseerCollectionProcessorTest, TestIndexSearcher, HighlighterTest, ShowFileRequestHandlerTest, CurrencyFieldOpenExchangeTest, SimplePostToolTest, SpellCheckCollatorTest, SuggesterFSTTest, SuggesterTSTTest, TestStressLucene, TestTrie, PolyFieldTest, WordBreakSolrSpellCheckerTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestUpdate, FieldMutatingUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, DocValuesMultiTest, TestSolrDeletionPolicy1, IndexBasedSpellCheckerTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestWriterPerf, TestReversedWildcardFilterFactory, TestQueryTypes, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, DocumentBuilderTest, TestValueSourceCache, TermVectorComponentTest, TestIndexingPerformance, MoreLikeThisHandlerTest, TestSolrQueryParser, TestArbitraryIndexDir, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, RegexBoostProcessorTest, TestJmxIntegration, JSONWriterTest, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, JsonLoaderTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, TestComponentsName, SearchHandlerTest, HighlighterConfigTest, SOLR749Test, TestQuerySenderNoQuery, SolrIndexConfigTest, BadComponentTest, TestMergePolicyConfig, MultiTermTest, SampleTest, TestBinaryField, TestSearchPerf, NumericFieldsTest, TestElisionMultitermQuery, TestConfig, OutputWriterTest, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, TestSolrCoreProperties, TestPostingsSolrHighlighter, SpellPossibilityIteratorTest, TestCharFilters, EchoParamsTest, TestSweetSpotSimilarityFactory, TestPerFieldSimilarity, TestNumberUtils, TestLMDirichletSimilarityFactory, TestIBSimilarityFactory, TestDefaultSimilarityFactory, TestJmxMonitoredMap, TimeZoneUtilsTest, TestFastOutputStream, ScriptEngineTest, OpenExchangeRatesOrgProviderTest, DateMathParserTest, PreAnalyzedFieldTest, DateFieldTest, SpellingQueryConverterTest, ClusterStateTest, TestSolrJ, ZkNodePropsTest, SystemInfoHandlerTest, UUIDFieldTest, CursorPagingTest, TestDistributedMissingSort, AbstractAnalyticsStatsTest, AbstractAnalyticsFacetTest, FieldFacetExtrasTest, FunctionTest, AliasIntegrationTest, AssignTest, DeleteShardTest, DistribCursorPagingTest, OverseerRolesTest]
[junit4] Completed in 25.81s, 1 test, 1 error <<< FAILURES!
[...truncated 145 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:453: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:433: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1268: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:901: There were test failures: 368 suites, 1593 tests, 2 errors, 40 ignored (6 assumptions)
Total time: 79 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build
# 1298 - Failure!
Posted by Mark Miller <ma...@gmail.com>.
Not knowing anything about this test yet, this exception really scares me. I’ll try and dig into this before long.
- Mark
http://about.me/markrmiller
On Feb 5, 2014, 3:34:17 PM, Policeman Jenkins Server <je...@thetaphi.de> wrote: Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1299/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.OverseerRolesTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=4317, name=Overseer-91201891705683984-127.0.0.1:50467_xamc%2Fcw-n_0000000006, state=RUNNABLE, group=Overseer collection creation process.]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4317, name=Overseer-91201891705683984-127.0.0.1:50467_xamc%2Fcw-n_0000000006, state=RUNNABLE, group=Overseer collection creation process.]
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
at __randomizedtesting.SeedInfo.seed([1D8D58FC52450139]:0)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:209)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qn-0000000004
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:170)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:170)
at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:193)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
... 1 more
Build Log:
[...truncated 10177 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
[junit4] 2> 1313860 T4161 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /xamc/cw
[junit4] 2> 1313867 T4161 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-OverseerRolesTest-1391630427634
[junit4] 2> 1313868 T4161 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1313869 T4162 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1313972 T4161 oasc.ZkTestServer.run start zk server on port:50445
[junit4] 2> 1313973 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1313980 T4168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cd51fae name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1313980 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1313981 T4161 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1313992 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1313996 T4170 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7122a59e name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1313997 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1313997 T4161 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1314005 T4161 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1314012 T4161 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1314018 T4161 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1314025 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1314025 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1314036 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1314037 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1314046 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1314046 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1314054 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1314054 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1314062 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1314062 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1314069 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1314069 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1314075 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1314076 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1314084 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1314085 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1314091 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1314092 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1314099 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1314099 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1314106 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1314106 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1314457 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1314465 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50448
[junit4] 2> 1314466 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1314466 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1314467 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882
[junit4] 2> 1314467 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/'
[junit4] 2> 1314494 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/solr.xml
[junit4] 2> 1314560 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1314561 T4161 oasc.CoreContainer.<init> New CoreContainer 1439064732
[junit4] 2> 1314561 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/]
[junit4] 2> 1314563 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1314563 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1314563 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1314564 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1314564 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1314564 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1314565 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1314565 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1314565 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1314575 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1314576 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1314576 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1314576 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1314577 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1314578 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1314582 T4181 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53741bc2 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1314582 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1314588 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1314591 T4183 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b5eb360 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1314592 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1314595 T4161 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1314604 T4161 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1314612 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1314616 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50448_xamc%2Fcw
[junit4] 2> 1314618 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50448_xamc%2Fcw
[junit4] 2> 1314626 T4161 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1314632 T4161 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1314643 T4161 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:50448_xamc%2Fcw
[junit4] 2> 1314643 T4161 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1314649 T4161 oasc.Overseer.start Overseer (id=91201891705683971-127.0.0.1:50448_xamc%2Fcw-n_0000000000) starting
[junit4] 2> 1314657 T4161 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1314666 T4185 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1314667 T4161 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1314669 T4185 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 1314672 T4161 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1314677 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1314685 T4184 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1314688 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882
[junit4] 2> 1314838 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/conf/
[junit4] 2> 1314846 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1314846 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1314847 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1314849 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1314853 T4188 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@422cd301 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1314854 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1314857 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1314862 T4161 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1315191 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1315191 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1315199 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50452
[junit4] 2> 1315200 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1315205 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1315205 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629
[junit4] 2> 1315205 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/'
[junit4] 2> 1315242 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/solr.xml
[junit4] 2> 1315326 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1315326 T4161 oasc.CoreContainer.<init> New CoreContainer 376968249
[junit4] 2> 1315326 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/]
[junit4] 2> 1315328 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1315328 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1315328 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1315328 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1315329 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1315329 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1315329 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1315330 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1315330 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1315339 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1315340 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1315340 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1315340 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1315341 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1315342 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1315347 T4199 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2577b5b5 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1315347 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1315353 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1315356 T4201 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54821fc3 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1315356 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1315366 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1316376 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50452_xamc%2Fcw
[junit4] 2> 1316378 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50452_xamc%2Fcw
[junit4] 2> 1316386 T4188 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1316388 T4201 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1316386 T4183 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1316404 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629
[junit4] 2> 1316556 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/conf/
[junit4] 2> 1316563 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1316564 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1316565 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1316965 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1316966 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1316972 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50455
[junit4] 2> 1316974 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1316974 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1316975 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332
[junit4] 2> 1316975 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/'
[junit4] 2> 1317004 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/solr.xml
[junit4] 2> 1317085 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1317086 T4161 oasc.CoreContainer.<init> New CoreContainer 1172197858
[junit4] 2> 1317086 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/]
[junit4] 2> 1317087 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1317088 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1317088 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1317088 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1317088 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1317089 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1317090 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1317090 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1317090 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1317100 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1317100 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1317100 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1317100 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1317101 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1317102 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1317107 T4213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d1f044 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1317108 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1317113 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1317118 T4215 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f340905 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1317118 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1317130 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1318144 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50455_xamc%2Fcw
[junit4] 2> 1318147 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50455_xamc%2Fcw
[junit4] 2> 1318155 T4183 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1318155 T4215 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1318155 T4201 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1318155 T4188 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1318173 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332
[junit4] 2> 1318329 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/conf/
[junit4] 2> 1318339 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1318340 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1318341 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1318728 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1318729 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1318735 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50458
[junit4] 2> 1318737 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1318737 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1318738 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107
[junit4] 2> 1318738 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/'
[junit4] 2> 1318766 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/solr.xml
[junit4] 2> 1318840 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1318840 T4161 oasc.CoreContainer.<init> New CoreContainer 529788194
[junit4] 2> 1318841 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/]
[junit4] 2> 1318842 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1318842 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1318843 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1318843 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1318843 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1318843 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1318844 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1318845 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1318845 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1318856 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1318856 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1318856 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1318857 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1318857 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1318858 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1318862 T4227 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28b56360 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1318863 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1318869 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1318873 T4229 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f9afb6 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1318874 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1318885 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1319894 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50458_xamc%2Fcw
[junit4] 2> 1319897 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50458_xamc%2Fcw
[junit4] 2> 1319905 T4229 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1319906 T4215 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1319906 T4183 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1319906 T4188 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1319906 T4201 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1319919 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107
[junit4] 2> 1320066 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/conf/
[junit4] 2> 1320074 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1320075 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1320076 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1320430 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 1320431 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1320436 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50461
[junit4] 2> 1320438 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1320439 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1320439 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842
[junit4] 2> 1320439 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/'
[junit4] 2> 1320468 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/solr.xml
[junit4] 2> 1320544 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1320545 T4161 oasc.CoreContainer.<init> New CoreContainer 511347573
[junit4] 2> 1320545 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/]
[junit4] 2> 1320546 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1320547 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1320547 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1320547 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1320548 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1320548 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1320548 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1320549 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1320549 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1320558 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1320559 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1320559 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1320560 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1320560 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1320561 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1320566 T4241 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f59bdf4 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1320566 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1320572 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1320581 T4243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c703837 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1320582 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1320594 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1321608 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50461_xamc%2Fcw
[junit4] 2> 1321610 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50461_xamc%2Fcw
[junit4] 2> 1321618 T4243 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321618 T4229 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321619 T4215 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321619 T4183 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321619 T4201 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321620 T4188 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321632 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842
[junit4] 2> 1321781 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/conf/
[junit4] 2> 1321789 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1321790 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1321791 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1322143 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
[junit4] 2> 1322144 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1322148 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50464
[junit4] 2> 1322150 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1322150 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1322150 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557
[junit4] 2> 1322151 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/'
[junit4] 2> 1322180 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/solr.xml
[junit4] 2> 1322265 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1322266 T4161 oasc.CoreContainer.<init> New CoreContainer 1110748447
[junit4] 2> 1322266 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/]
[junit4] 2> 1322267 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1322268 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1322268 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1322269 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1322269 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1322269 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1322270 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1322270 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1322271 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1322280 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1322281 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1322281 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1322282 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1322282 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1322283 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1322288 T4255 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1051f02e name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1322288 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1322294 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1322298 T4257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6af82ce0 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1322299 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1322310 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1323324 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50464_xamc%2Fcw
[junit4] 2> 1323326 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50464_xamc%2Fcw
[junit4] 2> 1323333 T4229 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323333 T4201 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323334 T4183 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323334 T4188 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323334 T4243 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323334 T4257 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323334 T4215 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323349 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557
[junit4] 2> 1323472 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/conf/
[junit4] 2> 1323477 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1323478 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1323478 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1323824 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
[junit4] 2> 1323825 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1323829 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50467
[junit4] 2> 1323831 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1323831 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1323831 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245
[junit4] 2> 1323832 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/'
[junit4] 2> 1323860 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/solr.xml
[junit4] 2> 1323932 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1323933 T4161 oasc.CoreContainer.<init> New CoreContainer 1330020159
[junit4] 2> 1323933 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/]
[junit4] 2> 1323934 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1323935 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1323935 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1323935 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1323936 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1323936 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1323936 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1323937 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1323937 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1323947 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1323948 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1323948 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1323948 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1323949 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1323950 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1323954 T4269 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d4c29c2 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1323955 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1323960 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1323965 T4271 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5976d916 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1323965 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1323976 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1324985 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50467_xamc%2Fcw
[junit4] 2> 1324988 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50467_xamc%2Fcw
[junit4] 2> 1324996 T4243 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4188 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4201 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4183 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4257 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4271 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4229 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4215 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1325009 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245
[junit4] 2> 1325107 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/conf/
[junit4] 2> 1325112 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1325113 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1325113 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1325114 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1325119 T4274 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b97bd1f name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1325120 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1325123 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1325131 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1325136 T4276 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e7ed4b4 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1325136 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1325139 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1325148 T4223 oasha.CollectionsHandler.handleCreateAction Creating Collection : wt=javabin&name=testOverseerCol&version=2&action=CREATE&numShards=4&maxShardsPerNode=2&replicationFactor=2
[junit4] 2> 1325151 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325155 T4185 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerCol",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 1325155 T4185 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerCol",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 1325157 T4185 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 1325157 T4185 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerCol
[junit4] 2> 1325157 T4185 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol
[junit4] 2> 1325168 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325173 T4184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1325175 T4184 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerCol
[junit4] 2> 1325175 T4184 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerCol with shards [shard1, shard2, shard3, shard4]
[junit4] 2> 1325181 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325184 T4188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4274 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4215 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325271 T4185 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2, shard3, shard4] , repFactor : 2
[junit4] 2> 1325271 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica1 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:50467_xamc%2Fcw
[junit4] 2> 1325272 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica2 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:50452_xamc%2Fcw
[junit4] 2> 1325272 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica1 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:50464_xamc%2Fcw
[junit4] 2> 1325273 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica2 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:50458_xamc%2Fcw
[junit4] 2> 1325275 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica1 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:50461_xamc%2Fcw
[junit4] 2> 1325279 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica2 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:50448_xamc%2Fcw
[junit4] 2> 1325286 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica1 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:50455_xamc%2Fcw
[junit4] 2> 1325292 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica2 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:50467_xamc%2Fcw
[junit4] 2> 1325297 T4175 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica2 state=down
[junit4] 2> 1325297 T4249 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica1 state=down
[junit4] 2> 1325297 T4225 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica2 state=down
[junit4] 2> 1325299 T4208 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica1 state=down
[junit4] 2> 1325300 T4266 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica2 state=down
[junit4] 2> 1325301 T4232 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica1 state=down
[junit4] 2> 1325299 T4265 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica1 state=down
[junit4] 2> 1325302 T4193 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica2 state=down
[junit4] 2> 1325304 T4249 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325305 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325304 T4175 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325306 T4225 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325305 T4208 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325305 T4266 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325307 T4232 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325306 T4193 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325306 T4265 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325309 T4184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1325310 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50464/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50464_xamc%2Fcw",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325316 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325318 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50448/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard3_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50448_xamc%2Fcw",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325324 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325327 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50467/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard4_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50467_xamc%2Fcw",
[junit4] 2> "shard":"shard4",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325333 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325335 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50455/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard4_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50455_xamc%2Fcw",
[junit4] 2> "shard":"shard4",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325341 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325343 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50458/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50458_xamc%2Fcw",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325349 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325352 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50452/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50452_xamc%2Fcw",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325358 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325360 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50461/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard3_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50461_xamc%2Fcw",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325366 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325368 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50467/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50467_xamc%2Fcw",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325374 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325482 T4201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325483 T4188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4215 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4274 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1326307 T4249 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica1
[junit4] 2> 1326307 T4225 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica2
[junit4] 2> 1326309 T4249 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica1' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/testOverseerCol_shard2_replica1
[junit4] 2> 1326309 T4249 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326309 T4225 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/testOverseerCol_shard2_replica2
[junit4] 2> 1326310 T4225 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326307 T4175 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica2
[junit4] 2> 1326310 T4265 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica1
[junit4] 2> 1326310 T4232 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica1
[junit4] 2> 1326313 T4175 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2
[junit4] 2> 1326313 T4175 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326313 T4265 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica1' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/testOverseerCol_shard1_replica1
[junit4] 2> 1326314 T4265 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326310 T4208 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica1
[junit4] 2> 1326315 T4232 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/testOverseerCol_shard3_replica1
[junit4] 2> 1326315 T4232 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326315 T4266 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica2
[junit4] 2> 1326316 T4208 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/testOverseerCol_shard4_replica1
[junit4] 2> 1326318 T4208 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326318 T4249 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326319 T4249 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326319 T4265 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326320 T4265 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326318 T4266 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica2' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/testOverseerCol_shard4_replica2
[junit4] 2> 1326320 T4266 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326320 T4232 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326321 T4232 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326317 T4225 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326321 T4225 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326317 T4193 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica2
[junit4] 2> 1326321 T4175 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326323 T4175 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326323 T4266 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326324 T4266 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326320 T4208 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326324 T4208 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326324 T4249 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/testOverseerCol_shard2_replica1/'
[junit4] 2> 1326323 T4193 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica2' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/testOverseerCol_shard1_replica2
[junit4] 2> 1326326 T4193 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326328 T4232 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/testOverseerCol_shard3_replica1/'
[junit4] 2> 1326328 T4265 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/testOverseerCol_shard1_replica1/'
[junit4] 2> 1326330 T4266 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/testOverseerCol_shard4_replica2/'
[junit4] 2> 1326335 T4193 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326336 T4193 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326350 T4225 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/testOverseerCol_shard2_replica2/'
[junit4] 2> 1326355 T4175 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/'
[junit4] 2> 1326355 T4208 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/testOverseerCol_shard4_replica1/'
[junit4] 2> 1326378 T4193 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/testOverseerCol_shard1_replica2/'
[junit4] 2> 1326558 T4265 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326575 T4193 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326580 T4266 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326607 T4232 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326621 T4225 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326631 T4208 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326683 T4175 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326686 T4249 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326770 T4266 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326798 T4266 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326807 T4266 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica2] Schema name=test
[junit4] 2> 1326879 T4265 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326887 T4208 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326888 T4265 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326895 T4208 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326905 T4193 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326907 T4232 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326911 T4208 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica1] Schema name=test
[junit4] 2> 1326912 T4232 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326914 T4193 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326922 T4232 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica1] Schema name=test
[junit4] 2> 1326928 T4265 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica1] Schema name=test
[junit4] 2> 1326928 T4175 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326943 T4193 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica2] Schema name=test
[junit4] 2> 1326946 T4249 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326948 T4249 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326952 T4175 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326960 T4175 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica2] Schema name=test
[junit4] 2> 1326987 T4249 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica1] Schema name=test
[junit4] 2> 1327164 T4225 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1327172 T4225 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1327180 T4225 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica2] Schema name=test
[junit4] 2> 1329064 T4175 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1329157 T4175 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1329225 T4175 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1329343 T4175 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1329369 T4249 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1329378 T4175 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1329383 T4232 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1329388 T4175 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1329391 T4175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1329391 T4175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1329391 T4175 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1329400 T4175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1329400 T4175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1329400 T4175 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1329401 T4175 oasc.SolrCore.<init> [testOverseerCol_shard3_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/data/
[junit4] 2> 1329401 T4175 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26b8c907
[junit4] 2> 1329403 T4175 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/data
[junit4] 2> 1329404 T4175 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/data/index/
[junit4] 2> 1329404 T4175 oasc.SolrCore.initIndex WARN [testOverseerCol_shard3_replica2] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1329404 T4175 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/data/index
[junit4] 2> 1329405 T4175 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=68.5556640625, floorSegmentMB=0.2333984375, forceMergeDeletesPctAllowed=0.8315621965137543, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7360673705503434
[junit4] 2> 1329406 T4175 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@952c1b5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60ba409c),segFN=segments_1,generation=1}
[junit4] 2> 1329406 T4175 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1329410 T4175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1329411 T4175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1329412 T4175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1329412 T4175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1329412 T4175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1329413 T4175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1329413 T4175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1329414 T4175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1329414 T4175 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1329415 T4175 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1329415 T4175 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1329415 T4175 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1329416 T4175 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1329416 T4175 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1329417 T4175 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1329418 T4175 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1329418 T4175 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1329429 T4175 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1329439 T4175 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1329439 T4175 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1329440 T4175 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=28, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1329441 T4175 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@952c1b5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60ba409c),segFN=segments_1,generation=1}
[junit4] 2> 1329441 T4175 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1329442 T4175 oass.SolrIndexSearcher.<init> Opening Searcher@1a776cd0 main
[junit4] 2> 1329465 T4232 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1329466 T4193 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1329467 T4249 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1329471 T4249 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1329478 T4193 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1329480 T4285 oasc.SolrCore.registerSearcher [testOverseerCol_shard3_replica2] Registered new searcher Searcher@1a776cd0 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1329484 T4175 oasc.CoreContainer.registerCore registering core: testOverseerCol_shard3_replica2
[junit4] 2> 1329484 T4175 oasc.ZkController.register Register replica - core:testOverseerCol_shard3_replica2 address:http://127.0.0.1:50448/xamc/cw collection:testOverseerCol shard:shard3
[junit4] 2> 1329491 T4175 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol/leader_elect/shard3/election
[junit4] 2> 1329502 T4266 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1329503 T4232 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1329536 T4266 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1329545 T4175 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 1329548 T4193 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1329550 T4266 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1329559 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1329559 T
[...truncated too long message...]
per.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:413)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:382)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:369)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1338203 T4271 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testOverseerCol/leader_elect/shard1/election/91201891705683984-core_node8-n_0000000001
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1338203 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338204 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338204 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338204 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338204 T4271 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1338204 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338204 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338205 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338205 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338205 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338205 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338205 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=lv, timezone=Asia/Dili
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=5,free=166461472,total=356515840
[junit4] 2> NOTE: All tests run in this JVM: [EnumFieldTest, TestSolrIndexConfig, TestReload, SignatureUpdateProcessorFactoryTest, TestNoOpRegenerator, ConvertedLegacyTest, TestAnalyzeInfixSuggestions, RecoveryZkTest, SpatialFilterTest, RequestHandlersTest, OverseerTest, TestDFRSimilarityFactory, CopyFieldTest, TestValueSourceCache, RegexBoostProcessorTest, PrimitiveFieldTypeTest, DistanceFunctionTest, ParsingFieldUpdateProcessorsTest, TestManagedSchema, ResourceLoaderTest, TestFaceting, InfoHandlerTest, CollectionsAPIDistributedZkTest, SyncSliceTest, TestSchemaResource, TestUpdate, TestFieldTypeCollectionResource, TestZkChroot, TestRemoteStreaming, PeerSyncTest, TestPostingsSolrHighlighter, ModifyConfFileTest, TestUniqueKeyFieldResource, TestSolrDeletionPolicy1, NoCacheHeaderTest, TestDocSet, TestCustomSort, DisMaxRequestHandlerTest, TestSearchPerf, IndexSchemaRuntimeFieldTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestStressLucene, ChaosMonkeyNothingIsSafeTest, TestCharFilters, TestModifyConfFiles, BasicZkTest, ShowFileRequestHandlerTest, DirectSolrSpellCheckerTest, CSVRequestHandlerTest, TimeZoneUtilsTest, ShardSplitTest, TestTrie, TestFastLRUCache, HardAutoCommitTest, TestDistributedSearch, LeaderElectionIntegrationTest, DocumentBuilderTest, TestLuceneMatchVersion, TestPartialUpdateDeduplication, MinimalSchemaTest, TestSolrXMLSerializer, TestCopyFieldCollectionResource, TestFiltering, SchemaVersionSpecificBehaviorTest, TestQueryUtils, SuggesterFSTTest, DistributedQueryComponentCustomSortTest, CacheHeaderTest, CoreMergeIndexesAdminHandlerTest, SpellingQueryConverterTest, SuggesterTSTTest, TestAtomicUpdateErrorCases, CursorPagingTest, TestSolrDeletionPolicy2, AssignTest, AnalysisAfterCoreReloadTest, AddBlockUpdateTest, SliceStateUpdateTest, UpdateRequestProcessorFactoryTest, LoggingHandlerTest, TestPerFieldSimilarity, DocumentAnalysisRequestHandlerTest, DeleteShardTest, TestFuzzyAnalyzedSuggestions, StatsComponentTest, CoreContainerCoreInitFailuresTest, QueryResultKeyTest, TestDynamicFieldResource, DateFieldTest, TestSimpleQParserPlugin, TestSolr4Spatial, AutoCommitTest, NotRequiredUniqueKeyTest, DeleteReplicaTest, DistributedDebugComponentTest, CircularListTest, TestAnalyzedSuggestions, SolrIndexConfigTest, TestFieldCollectionResource, SimpleFacetsTest, BasicFunctionalityTest, TestRecovery, TestPseudoReturnFields, DistributedSpellCheckComponentTest, TestWriterPerf, SystemInfoHandlerTest, SampleTest, EchoParamsTest, ChangedSchemaMergeTest, TestJmxMonitoredMap, SolrRequestParserTest, TestSolrQueryParserResource, TestInitQParser, TestWordDelimiterFilterFactory, CoreAdminHandlerTest, PreAnalyzedUpdateProcessorTest, TestFileDictionaryLookup, TestCollapseQParserPlugin, BadCopyFieldTest, TestMultiCoreConfBootstrap, SuggesterWFSTTest, OverseerRolesTest]
[junit4] Completed in 24.44s, 1 test, 1 error <<< FAILURES!
[...truncated 743 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:453: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:433: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1268: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:901: There were test failures: 368 suites, 1593 tests, 1 error, 40 ignored (6 assumptions)
Total time: 85 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org
[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.7.0) - Build # 1299
- Still Failing!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/1299/
Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC
1 tests failed.
FAILED: org.apache.solr.cloud.OverseerRolesTest.testDistribSearch
Error Message:
Captured an uncaught exception in thread: Thread[id=4317, name=Overseer-91201891705683984-127.0.0.1:50467_xamc%2Fcw-n_0000000006, state=RUNNABLE, group=Overseer collection creation process.]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=4317, name=Overseer-91201891705683984-127.0.0.1:50467_xamc%2Fcw-n_0000000006, state=RUNNABLE, group=Overseer collection creation process.]
Caused by: org.apache.solr.common.cloud.ZooKeeperException:
at __randomizedtesting.SeedInfo.seed([1D8D58FC52450139]:0)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:209)
at java.lang.Thread.run(Thread.java:744)
Caused by: org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /overseer/collection-queue-work/qn-0000000004
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:170)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:170)
at org.apache.solr.cloud.DistributedQueue.remove(DistributedQueue.java:193)
at org.apache.solr.cloud.OverseerCollectionProcessor.run(OverseerCollectionProcessor.java:200)
... 1 more
Build Log:
[...truncated 10177 lines...]
[junit4] Suite: org.apache.solr.cloud.OverseerRolesTest
[junit4] 2> 1313860 T4161 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /xamc/cw
[junit4] 2> 1313867 T4161 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./solrtest-OverseerRolesTest-1391630427634
[junit4] 2> 1313868 T4161 oasc.ZkTestServer.run STARTING ZK TEST SERVER
[junit4] 2> 1313869 T4162 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
[junit4] 2> 1313972 T4161 oasc.ZkTestServer.run start zk server on port:50445
[junit4] 2> 1313973 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1313980 T4168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@cd51fae name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1313980 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1313981 T4161 oascc.SolrZkClient.makePath makePath: /solr
[junit4] 2> 1313992 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1313996 T4170 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7122a59e name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1313997 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1313997 T4161 oascc.SolrZkClient.makePath makePath: /collections/collection1
[junit4] 2> 1314005 T4161 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
[junit4] 2> 1314012 T4161 oascc.SolrZkClient.makePath makePath: /collections/control_collection
[junit4] 2> 1314018 T4161 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
[junit4] 2> 1314025 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1314025 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
[junit4] 2> 1314036 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
[junit4] 2> 1314037 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
[junit4] 2> 1314046 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1314046 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1314054 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1314054 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
[junit4] 2> 1314062 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1314062 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
[junit4] 2> 1314069 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1314069 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
[junit4] 2> 1314075 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1314076 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
[junit4] 2> 1314084 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1314085 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
[junit4] 2> 1314091 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1314092 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1314099 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1314099 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
[junit4] 2> 1314106 T4161 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1314106 T4161 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
[junit4] 2> 1314457 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1314465 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50448
[junit4] 2> 1314466 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1314466 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1314467 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882
[junit4] 2> 1314467 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/'
[junit4] 2> 1314494 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/solr.xml
[junit4] 2> 1314560 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1314561 T4161 oasc.CoreContainer.<init> New CoreContainer 1439064732
[junit4] 2> 1314561 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/]
[junit4] 2> 1314563 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1314563 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1314563 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1314564 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1314564 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1314564 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1314565 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1314565 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1314565 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1314575 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1314576 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1314576 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1314576 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1314577 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1314578 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1314582 T4181 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@53741bc2 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1314582 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1314588 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1314591 T4183 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1b5eb360 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1314592 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1314595 T4161 oascc.SolrZkClient.makePath makePath: /overseer/queue
[junit4] 2> 1314604 T4161 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
[junit4] 2> 1314612 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes
[junit4] 2> 1314616 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50448_xamc%2Fcw
[junit4] 2> 1314618 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50448_xamc%2Fcw
[junit4] 2> 1314626 T4161 oascc.SolrZkClient.makePath makePath: /overseer_elect
[junit4] 2> 1314632 T4161 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
[junit4] 2> 1314643 T4161 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:50448_xamc%2Fcw
[junit4] 2> 1314643 T4161 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
[junit4] 2> 1314649 T4161 oasc.Overseer.start Overseer (id=91201891705683971-127.0.0.1:50448_xamc%2Fcw-n_0000000000) starting
[junit4] 2> 1314657 T4161 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
[junit4] 2> 1314666 T4185 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
[junit4] 2> 1314667 T4161 oascc.SolrZkClient.makePath makePath: /clusterstate.json
[junit4] 2> 1314669 T4185 oasc.OverseerCollectionProcessor.prioritizeOverseerNodes prioritizing overseer nodes
[junit4] 2> 1314672 T4161 oascc.SolrZkClient.makePath makePath: /aliases.json
[junit4] 2> 1314677 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1314685 T4184 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
[junit4] 2> 1314688 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882
[junit4] 2> 1314838 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/conf/
[junit4] 2> 1314846 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1314846 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1314847 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1314849 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1314853 T4188 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@422cd301 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1314854 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1314857 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1314862 T4161 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1315191 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
[junit4] 2> 1315191 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1315199 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50452
[junit4] 2> 1315200 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1315205 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1315205 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629
[junit4] 2> 1315205 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/'
[junit4] 2> 1315242 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/solr.xml
[junit4] 2> 1315326 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1315326 T4161 oasc.CoreContainer.<init> New CoreContainer 376968249
[junit4] 2> 1315326 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/]
[junit4] 2> 1315328 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1315328 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1315328 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1315328 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1315329 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1315329 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1315329 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1315330 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1315330 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1315339 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1315340 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1315340 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1315340 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1315341 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1315342 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1315347 T4199 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2577b5b5 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1315347 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1315353 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1315356 T4201 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54821fc3 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1315356 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1315366 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1316376 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50452_xamc%2Fcw
[junit4] 2> 1316378 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50452_xamc%2Fcw
[junit4] 2> 1316386 T4188 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1316388 T4201 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1316386 T4183 oascc.ZkStateReader$3.process Updating live nodes... (2)
[junit4] 2> 1316404 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629
[junit4] 2> 1316556 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/conf/
[junit4] 2> 1316563 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1316564 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1316565 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1316965 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
[junit4] 2> 1316966 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1316972 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50455
[junit4] 2> 1316974 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1316974 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1316975 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332
[junit4] 2> 1316975 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/'
[junit4] 2> 1317004 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/solr.xml
[junit4] 2> 1317085 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1317086 T4161 oasc.CoreContainer.<init> New CoreContainer 1172197858
[junit4] 2> 1317086 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/]
[junit4] 2> 1317087 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1317088 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1317088 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1317088 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1317088 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1317089 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1317090 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1317090 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1317090 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1317100 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1317100 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1317100 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1317100 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1317101 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1317102 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1317107 T4213 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d1f044 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1317108 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1317113 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1317118 T4215 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6f340905 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1317118 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1317130 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1318144 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50455_xamc%2Fcw
[junit4] 2> 1318147 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50455_xamc%2Fcw
[junit4] 2> 1318155 T4183 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1318155 T4215 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1318155 T4201 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1318155 T4188 oascc.ZkStateReader$3.process Updating live nodes... (3)
[junit4] 2> 1318173 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332
[junit4] 2> 1318329 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/conf/
[junit4] 2> 1318339 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1318340 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1318341 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1318728 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
[junit4] 2> 1318729 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1318735 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50458
[junit4] 2> 1318737 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1318737 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1318738 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107
[junit4] 2> 1318738 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/'
[junit4] 2> 1318766 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/solr.xml
[junit4] 2> 1318840 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1318840 T4161 oasc.CoreContainer.<init> New CoreContainer 529788194
[junit4] 2> 1318841 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/]
[junit4] 2> 1318842 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1318842 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1318843 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1318843 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1318843 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1318843 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1318844 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1318845 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1318845 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1318856 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1318856 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1318856 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1318857 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1318857 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1318858 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1318862 T4227 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@28b56360 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1318863 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1318869 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1318873 T4229 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4f9afb6 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1318874 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1318885 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1319894 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50458_xamc%2Fcw
[junit4] 2> 1319897 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50458_xamc%2Fcw
[junit4] 2> 1319905 T4229 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1319906 T4215 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1319906 T4183 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1319906 T4188 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1319906 T4201 oascc.ZkStateReader$3.process Updating live nodes... (4)
[junit4] 2> 1319919 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107
[junit4] 2> 1320066 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/conf/
[junit4] 2> 1320074 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1320075 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1320076 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1320430 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 4
[junit4] 2> 1320431 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1320436 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50461
[junit4] 2> 1320438 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1320439 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1320439 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842
[junit4] 2> 1320439 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/'
[junit4] 2> 1320468 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/solr.xml
[junit4] 2> 1320544 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1320545 T4161 oasc.CoreContainer.<init> New CoreContainer 511347573
[junit4] 2> 1320545 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/]
[junit4] 2> 1320546 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1320547 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1320547 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1320547 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1320548 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1320548 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1320548 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1320549 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1320549 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1320558 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1320559 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1320559 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1320560 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1320560 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1320561 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1320566 T4241 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f59bdf4 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1320566 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1320572 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1320581 T4243 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3c703837 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1320582 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1320594 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1321608 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50461_xamc%2Fcw
[junit4] 2> 1321610 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50461_xamc%2Fcw
[junit4] 2> 1321618 T4243 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321618 T4229 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321619 T4215 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321619 T4183 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321619 T4201 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321620 T4188 oascc.ZkStateReader$3.process Updating live nodes... (5)
[junit4] 2> 1321632 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842
[junit4] 2> 1321781 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/conf/
[junit4] 2> 1321789 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1321790 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1321791 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1322143 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 5
[junit4] 2> 1322144 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1322148 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50464
[junit4] 2> 1322150 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1322150 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1322150 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557
[junit4] 2> 1322151 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/'
[junit4] 2> 1322180 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/solr.xml
[junit4] 2> 1322265 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1322266 T4161 oasc.CoreContainer.<init> New CoreContainer 1110748447
[junit4] 2> 1322266 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/]
[junit4] 2> 1322267 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1322268 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1322268 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1322269 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1322269 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1322269 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1322270 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1322270 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1322271 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1322280 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1322281 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1322281 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1322282 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1322282 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1322283 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1322288 T4255 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1051f02e name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1322288 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1322294 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1322298 T4257 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6af82ce0 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1322299 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1322310 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1323324 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50464_xamc%2Fcw
[junit4] 2> 1323326 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50464_xamc%2Fcw
[junit4] 2> 1323333 T4229 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323333 T4201 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323334 T4183 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323334 T4188 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323334 T4243 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323334 T4257 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323334 T4215 oascc.ZkStateReader$3.process Updating live nodes... (6)
[junit4] 2> 1323349 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557
[junit4] 2> 1323472 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/conf/
[junit4] 2> 1323477 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1323478 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1323478 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1323824 T4161 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 6
[junit4] 2> 1323825 T4161 oejs.Server.doStart jetty-8.1.10.v20130312
[junit4] 2> 1323829 T4161 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:50467
[junit4] 2> 1323831 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
[junit4] 2> 1323831 T4161 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
[junit4] 2> 1323831 T4161 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245
[junit4] 2> 1323832 T4161 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/'
[junit4] 2> 1323860 T4161 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/solr.xml
[junit4] 2> 1323932 T4161 oasc.ConfigSolrXml.<init> Config-defined core root directory:
[junit4] 2> 1323933 T4161 oasc.CoreContainer.<init> New CoreContainer 1330020159
[junit4] 2> 1323933 T4161 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/]
[junit4] 2> 1323934 T4161 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
[junit4] 2> 1323935 T4161 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: http://
[junit4] 2> 1323935 T4161 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
[junit4] 2> 1323935 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
[junit4] 2> 1323936 T4161 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
[junit4] 2> 1323936 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
[junit4] 2> 1323936 T4161 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
[junit4] 2> 1323937 T4161 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
[junit4] 2> 1323937 T4161 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
[junit4] 2> 1323947 T4161 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
[junit4] 2> 1323948 T4161 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
[junit4] 2> 1323948 T4161 oasc.CoreContainer.load Host Name: 127.0.0.1
[junit4] 2> 1323948 T4161 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:50445/solr
[junit4] 2> 1323949 T4161 oasc.ZkController.checkChrootPath zkHost includes chroot
[junit4] 2> 1323950 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1323954 T4269 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d4c29c2 name:ZooKeeperConnection Watcher:127.0.0.1:50445 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1323955 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1323960 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1323965 T4271 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5976d916 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1323965 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1323976 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1324985 T4161 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:50467_xamc%2Fcw
[junit4] 2> 1324988 T4161 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:50467_xamc%2Fcw
[junit4] 2> 1324996 T4243 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4188 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4201 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4183 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4257 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4271 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4229 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1324997 T4215 oascc.ZkStateReader$3.process Updating live nodes... (7)
[junit4] 2> 1325009 T4161 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245
[junit4] 2> 1325107 T4161 oasc.CorePropertiesLocator.discoverUnder Found core conf in /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/conf/
[junit4] 2> 1325112 T4161 oasc.CorePropertiesLocator.discover Found 1 core definitions
[junit4] 2> 1325113 T4161 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
[junit4] 2> 1325113 T4161 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
[junit4] 2> 1325114 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1325119 T4274 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@b97bd1f name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1325120 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1325123 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1325131 T4161 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
[junit4] 2> 1325136 T4276 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2e7ed4b4 name:ZooKeeperConnection Watcher:127.0.0.1:50445/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
[junit4] 2> 1325136 T4161 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
[junit4] 2> 1325139 T4161 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper...
[junit4] 2> 1325148 T4223 oasha.CollectionsHandler.handleCreateAction Creating Collection : wt=javabin&name=testOverseerCol&version=2&action=CREATE&numShards=4&maxShardsPerNode=2&replicationFactor=2
[junit4] 2> 1325151 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/collection-queue-work state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325155 T4185 oasc.OverseerCollectionProcessor.run Overseer Collection Processor: Get the message id:/overseer/collection-queue-work/qn-0000000000 message:{
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerCol",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 1325155 T4185 oasc.OverseerCollectionProcessor.processMessage WARN OverseerCollectionProcessor.processMessage : createcollection , {
[junit4] 2> "operation":"createcollection",
[junit4] 2> "fromApi":"true",
[junit4] 2> "name":"testOverseerCol",
[junit4] 2> "replicationFactor":"2",
[junit4] 2> "numShards":"4",
[junit4] 2> "maxShardsPerNode":"2"}
[junit4] 2> 1325157 T4185 oasc.OverseerCollectionProcessor.createConfNode Only one config set found in zk - using it:conf1
[junit4] 2> 1325157 T4185 oasc.OverseerCollectionProcessor.createConfNode creating collections conf node /collections/testOverseerCol
[junit4] 2> 1325157 T4185 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol
[junit4] 2> 1325168 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325173 T4184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1325175 T4184 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: testOverseerCol
[junit4] 2> 1325175 T4184 oasc.Overseer$ClusterStateUpdater.createCollection Create collection testOverseerCol with shards [shard1, shard2, shard3, shard4]
[junit4] 2> 1325181 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325184 T4188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4274 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4215 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325185 T4201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325271 T4185 oasc.OverseerCollectionProcessor.createCollection going to create cores replicas shardNames [shard1, shard2, shard3, shard4] , repFactor : 2
[junit4] 2> 1325271 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica1 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:50467_xamc%2Fcw
[junit4] 2> 1325272 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard1_replica2 as part of slice shard1 of collection testOverseerCol on 127.0.0.1:50452_xamc%2Fcw
[junit4] 2> 1325272 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica1 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:50464_xamc%2Fcw
[junit4] 2> 1325273 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard2_replica2 as part of slice shard2 of collection testOverseerCol on 127.0.0.1:50458_xamc%2Fcw
[junit4] 2> 1325275 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica1 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:50461_xamc%2Fcw
[junit4] 2> 1325279 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard3_replica2 as part of slice shard3 of collection testOverseerCol on 127.0.0.1:50448_xamc%2Fcw
[junit4] 2> 1325286 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica1 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:50455_xamc%2Fcw
[junit4] 2> 1325292 T4185 oasc.OverseerCollectionProcessor.createCollection Creating shard testOverseerCol_shard4_replica2 as part of slice shard4 of collection testOverseerCol on 127.0.0.1:50467_xamc%2Fcw
[junit4] 2> 1325297 T4175 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica2 state=down
[junit4] 2> 1325297 T4249 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica1 state=down
[junit4] 2> 1325297 T4225 oasc.ZkController.publish publishing core=testOverseerCol_shard2_replica2 state=down
[junit4] 2> 1325299 T4208 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica1 state=down
[junit4] 2> 1325300 T4266 oasc.ZkController.publish publishing core=testOverseerCol_shard4_replica2 state=down
[junit4] 2> 1325301 T4232 oasc.ZkController.publish publishing core=testOverseerCol_shard3_replica1 state=down
[junit4] 2> 1325299 T4265 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica1 state=down
[junit4] 2> 1325302 T4193 oasc.ZkController.publish publishing core=testOverseerCol_shard1_replica2 state=down
[junit4] 2> 1325304 T4249 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325305 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325304 T4175 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325306 T4225 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325305 T4208 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325305 T4266 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325307 T4232 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325306 T4193 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325306 T4265 oasc.ZkController.waitForCoreNodeName look for our core node name
[junit4] 2> 1325309 T4184 oascc.ZkStateReader.updateClusterState Updating cloud state from ZooKeeper...
[junit4] 2> 1325310 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50464/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard2_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50464_xamc%2Fcw",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325316 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325318 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50448/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard3_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50448_xamc%2Fcw",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325324 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325327 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50467/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard4_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50467_xamc%2Fcw",
[junit4] 2> "shard":"shard4",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325333 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325335 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50455/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard4_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50455_xamc%2Fcw",
[junit4] 2> "shard":"shard4",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325341 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325343 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50458/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard2_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50458_xamc%2Fcw",
[junit4] 2> "shard":"shard2",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325349 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325352 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50452/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard1_replica2",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50452_xamc%2Fcw",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325358 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325360 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50461/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard3_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50461_xamc%2Fcw",
[junit4] 2> "shard":"shard3",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325366 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325368 T4184 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=4 message={
[junit4] 2> "operation":"state",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:50467/xamc/cw",
[junit4] 2> "core":"testOverseerCol_shard1_replica1",
[junit4] 2> "roles":null,
[junit4] 2> "node_name":"127.0.0.1:50467_xamc%2Fcw",
[junit4] 2> "shard":"shard1",
[junit4] 2> "shard_range":null,
[junit4] 2> "shard_state":"active",
[junit4] 2> "shard_parent":null,
[junit4] 2> "collection":"testOverseerCol",
[junit4] 2> "numShards":"4",
[junit4] 2> "core_node_name":null}
[junit4] 2> 1325374 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1325482 T4201 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4229 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4243 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325483 T4188 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4271 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4215 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4183 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4274 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4276 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1325482 T4257 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 7)
[junit4] 2> 1326307 T4249 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica1
[junit4] 2> 1326307 T4225 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard2_replica2
[junit4] 2> 1326309 T4249 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica1' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/testOverseerCol_shard2_replica1
[junit4] 2> 1326309 T4249 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326309 T4225 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard2_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/testOverseerCol_shard2_replica2
[junit4] 2> 1326310 T4225 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326307 T4175 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica2
[junit4] 2> 1326310 T4265 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica1
[junit4] 2> 1326310 T4232 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard3_replica1
[junit4] 2> 1326313 T4175 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica2' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2
[junit4] 2> 1326313 T4175 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326313 T4265 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica1' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/testOverseerCol_shard1_replica1
[junit4] 2> 1326314 T4265 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326310 T4208 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica1
[junit4] 2> 1326315 T4232 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard3_replica1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/testOverseerCol_shard3_replica1
[junit4] 2> 1326315 T4232 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326315 T4266 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard4_replica2
[junit4] 2> 1326316 T4208 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica1' using instanceDir: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/testOverseerCol_shard4_replica1
[junit4] 2> 1326318 T4208 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326318 T4249 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326319 T4249 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326319 T4265 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326320 T4265 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326318 T4266 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard4_replica2' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/testOverseerCol_shard4_replica2
[junit4] 2> 1326320 T4266 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326320 T4232 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326321 T4232 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326317 T4225 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326321 T4225 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326317 T4193 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for testOverseerCol_shard1_replica2
[junit4] 2> 1326321 T4175 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326323 T4175 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326323 T4266 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326324 T4266 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326320 T4208 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326324 T4208 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326324 T4249 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty5-1391630435557/testOverseerCol_shard2_replica1/'
[junit4] 2> 1326323 T4193 oasc.CoreContainer.create Creating SolrCore 'testOverseerCol_shard1_replica2' using instanceDir: ./org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/testOverseerCol_shard1_replica2
[junit4] 2> 1326326 T4193 oasc.ZkController.createCollectionZkNode Check for collection zkNode:testOverseerCol
[junit4] 2> 1326328 T4232 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty4-1391630433842/testOverseerCol_shard3_replica1/'
[junit4] 2> 1326328 T4265 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/testOverseerCol_shard1_replica1/'
[junit4] 2> 1326330 T4266 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty6-1391630437245/testOverseerCol_shard4_replica2/'
[junit4] 2> 1326335 T4193 oasc.ZkController.createCollectionZkNode Collection zkNode exists
[junit4] 2> 1326336 T4193 oascc.ZkStateReader.readConfigName Load collection config from:/collections/testOverseerCol
[junit4] 2> 1326350 T4225 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty3-1391630432107/testOverseerCol_shard2_replica2/'
[junit4] 2> 1326355 T4175 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/'
[junit4] 2> 1326355 T4208 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-jetty2-1391630430332/testOverseerCol_shard4_replica1/'
[junit4] 2> 1326378 T4193 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: './org.apache.solr.cloud.OverseerRolesTest-jetty1-1391630428629/testOverseerCol_shard1_replica2/'
[junit4] 2> 1326558 T4265 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326575 T4193 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326580 T4266 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326607 T4232 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326621 T4225 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326631 T4208 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326683 T4175 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326686 T4249 oasc.SolrConfig.<init> Using Lucene MatchVersion: LUCENE_50
[junit4] 2> 1326770 T4266 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326798 T4266 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326807 T4266 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica2] Schema name=test
[junit4] 2> 1326879 T4265 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326887 T4208 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326888 T4265 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326895 T4208 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326905 T4193 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326907 T4232 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326911 T4208 oass.IndexSchema.readSchema [testOverseerCol_shard4_replica1] Schema name=test
[junit4] 2> 1326912 T4232 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326914 T4193 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326922 T4232 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica1] Schema name=test
[junit4] 2> 1326928 T4265 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica1] Schema name=test
[junit4] 2> 1326928 T4175 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326943 T4193 oass.IndexSchema.readSchema [testOverseerCol_shard1_replica2] Schema name=test
[junit4] 2> 1326946 T4249 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1326948 T4249 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326952 T4175 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1326960 T4175 oass.IndexSchema.readSchema [testOverseerCol_shard3_replica2] Schema name=test
[junit4] 2> 1326987 T4249 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica1] Schema name=test
[junit4] 2> 1327164 T4225 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
[junit4] 2> 1327172 T4225 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
[junit4] 2> 1327180 T4225 oass.IndexSchema.readSchema [testOverseerCol_shard2_replica2] Schema name=test
[junit4] 2> 1329064 T4175 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1329157 T4175 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1329225 T4175 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1329343 T4175 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1329369 T4249 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1329378 T4175 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
[junit4] 2> 1329383 T4232 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1329388 T4175 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1329391 T4175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1329391 T4175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1329391 T4175 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
[junit4] 2> 1329400 T4175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
[junit4] 2> 1329400 T4175 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
[junit4] 2> 1329400 T4175 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
[junit4] 2> 1329401 T4175 oasc.SolrCore.<init> [testOverseerCol_shard3_replica2] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/, dataDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/data/
[junit4] 2> 1329401 T4175 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26b8c907
[junit4] 2> 1329403 T4175 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/data
[junit4] 2> 1329404 T4175 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/data/index/
[junit4] 2> 1329404 T4175 oasc.SolrCore.initIndex WARN [testOverseerCol_shard3_replica2] Solr index directory '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/data/index' doesn't exist. Creating new index...
[junit4] 2> 1329404 T4175 oasc.CachingDirectoryFactory.get return new directory for ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/./org.apache.solr.cloud.OverseerRolesTest-controljetty-1391630427882/testOverseerCol_shard3_replica2/data/index
[junit4] 2> 1329405 T4175 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=41, maxMergeAtOnceExplicit=41, maxMergedSegmentMB=68.5556640625, floorSegmentMB=0.2333984375, forceMergeDeletesPctAllowed=0.8315621965137543, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7360673705503434
[junit4] 2> 1329406 T4175 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@952c1b5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60ba409c),segFN=segments_1,generation=1}
[junit4] 2> 1329406 T4175 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1329410 T4175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
[junit4] 2> 1329411 T4175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
[junit4] 2> 1329412 T4175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
[junit4] 2> 1329412 T4175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
[junit4] 2> 1329412 T4175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
[junit4] 2> 1329413 T4175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
[junit4] 2> 1329413 T4175 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1329414 T4175 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
[junit4] 2> 1329414 T4175 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
[junit4] 2> 1329415 T4175 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
[junit4] 2> 1329415 T4175 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
[junit4] 2> 1329415 T4175 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
[junit4] 2> 1329416 T4175 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
[junit4] 2> 1329416 T4175 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
[junit4] 2> 1329417 T4175 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
[junit4] 2> 1329418 T4175 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
[junit4] 2> 1329418 T4175 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
[junit4] 2> 1329429 T4175 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
[junit4] 2> 1329439 T4175 oasu.CommitTracker.<init> Hard AutoCommit: disabled
[junit4] 2> 1329439 T4175 oasu.CommitTracker.<init> Soft AutoCommit: disabled
[junit4] 2> 1329440 T4175 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=28, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 1329441 T4175 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
[junit4] 2> commit{dir=MockDirectoryWrapper(RAMDirectory@952c1b5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@60ba409c),segFN=segments_1,generation=1}
[junit4] 2> 1329441 T4175 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
[junit4] 2> 1329442 T4175 oass.SolrIndexSearcher.<init> Opening Searcher@1a776cd0 main
[junit4] 2> 1329465 T4232 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1329466 T4193 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1329467 T4249 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1329471 T4249 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1329478 T4193 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1329480 T4285 oasc.SolrCore.registerSearcher [testOverseerCol_shard3_replica2] Registered new searcher Searcher@1a776cd0 main{StandardDirectoryReader(segments_1:1:nrt)}
[junit4] 2> 1329484 T4175 oasc.CoreContainer.registerCore registering core: testOverseerCol_shard3_replica2
[junit4] 2> 1329484 T4175 oasc.ZkController.register Register replica - core:testOverseerCol_shard3_replica2 address:http://127.0.0.1:50448/xamc/cw collection:testOverseerCol shard:shard3
[junit4] 2> 1329491 T4175 oascc.SolrZkClient.makePath makePath: /collections/testOverseerCol/leader_elect/shard3/election
[junit4] 2> 1329502 T4266 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
[junit4] 2> 1329503 T4232 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1329536 T4266 oass.IndexSchema.readSchema default search field in schema is text
[junit4] 2> 1329545 T4175 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard3
[junit4] 2> 1329548 T4193 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1329550 T4266 oass.IndexSchema.readSchema unique key field: id
[junit4] 2> 1329559 T4183 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1329559 T
[...truncated too long message...]
per.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1041)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:205)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$3.execute(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:202)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:413)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:382)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:369)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:112)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:273)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1338203 T4271 oasc.LeaderElector$1.process WARN org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections/testOverseerCol/leader_elect/shard1/election/91201891705683984-core_node8-n_0000000001
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
[junit4] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
[junit4] 2> at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:873)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:173)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient$2.execute(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
[junit4] 2> at org.apache.solr.common.cloud.SolrZkClient.delete(SolrZkClient.java:170)
[junit4] 2> at org.apache.solr.cloud.ElectionContext.cancelElection(ElectionContext.java:67)
[junit4] 2> at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:293)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:164)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:108)
[junit4] 2> at org.apache.solr.cloud.LeaderElector.access$000(LeaderElector.java:55)
[junit4] 2> at org.apache.solr.cloud.LeaderElector$1.process(LeaderElector.java:137)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:519)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:495)
[junit4] 2>
[junit4] 2> 1338203 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338204 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338204 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338204 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338204 T4271 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
[junit4] 2> 1338204 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338204 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338205 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338205 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338205 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338205 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> 1338205 T4271 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
[junit4] 2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=true,coord=crazy): {}, locale=lv, timezone=Asia/Dili
[junit4] 2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.7.0_51 (64-bit)/cpus=2,threads=5,free=166461472,total=356515840
[junit4] 2> NOTE: All tests run in this JVM: [EnumFieldTest, TestSolrIndexConfig, TestReload, SignatureUpdateProcessorFactoryTest, TestNoOpRegenerator, ConvertedLegacyTest, TestAnalyzeInfixSuggestions, RecoveryZkTest, SpatialFilterTest, RequestHandlersTest, OverseerTest, TestDFRSimilarityFactory, CopyFieldTest, TestValueSourceCache, RegexBoostProcessorTest, PrimitiveFieldTypeTest, DistanceFunctionTest, ParsingFieldUpdateProcessorsTest, TestManagedSchema, ResourceLoaderTest, TestFaceting, InfoHandlerTest, CollectionsAPIDistributedZkTest, SyncSliceTest, TestSchemaResource, TestUpdate, TestFieldTypeCollectionResource, TestZkChroot, TestRemoteStreaming, PeerSyncTest, TestPostingsSolrHighlighter, ModifyConfFileTest, TestUniqueKeyFieldResource, TestSolrDeletionPolicy1, NoCacheHeaderTest, TestDocSet, TestCustomSort, DisMaxRequestHandlerTest, TestSearchPerf, IndexSchemaRuntimeFieldTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestStressLucene, ChaosMonkeyNothingIsSafeTest, TestCharFilters, TestModifyConfFiles, BasicZkTest, ShowFileRequestHandlerTest, DirectSolrSpellCheckerTest, CSVRequestHandlerTest, TimeZoneUtilsTest, ShardSplitTest, TestTrie, TestFastLRUCache, HardAutoCommitTest, TestDistributedSearch, LeaderElectionIntegrationTest, DocumentBuilderTest, TestLuceneMatchVersion, TestPartialUpdateDeduplication, MinimalSchemaTest, TestSolrXMLSerializer, TestCopyFieldCollectionResource, TestFiltering, SchemaVersionSpecificBehaviorTest, TestQueryUtils, SuggesterFSTTest, DistributedQueryComponentCustomSortTest, CacheHeaderTest, CoreMergeIndexesAdminHandlerTest, SpellingQueryConverterTest, SuggesterTSTTest, TestAtomicUpdateErrorCases, CursorPagingTest, TestSolrDeletionPolicy2, AssignTest, AnalysisAfterCoreReloadTest, AddBlockUpdateTest, SliceStateUpdateTest, UpdateRequestProcessorFactoryTest, LoggingHandlerTest, TestPerFieldSimilarity, DocumentAnalysisRequestHandlerTest, DeleteShardTest, TestFuzzyAnalyzedSuggestions, StatsComponentTest, CoreContainerCoreInitFailuresTest, QueryResultKeyTest, TestDynamicFieldResource, DateFieldTest, TestSimpleQParserPlugin, TestSolr4Spatial, AutoCommitTest, NotRequiredUniqueKeyTest, DeleteReplicaTest, DistributedDebugComponentTest, CircularListTest, TestAnalyzedSuggestions, SolrIndexConfigTest, TestFieldCollectionResource, SimpleFacetsTest, BasicFunctionalityTest, TestRecovery, TestPseudoReturnFields, DistributedSpellCheckComponentTest, TestWriterPerf, SystemInfoHandlerTest, SampleTest, EchoParamsTest, ChangedSchemaMergeTest, TestJmxMonitoredMap, SolrRequestParserTest, TestSolrQueryParserResource, TestInitQParser, TestWordDelimiterFilterFactory, CoreAdminHandlerTest, PreAnalyzedUpdateProcessorTest, TestFileDictionaryLookup, TestCollapseQParserPlugin, BadCopyFieldTest, TestMultiCoreConfBootstrap, SuggesterWFSTTest, OverseerRolesTest]
[junit4] Completed in 24.44s, 1 test, 1 error <<< FAILURES!
[...truncated 743 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:453: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:433: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:37: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:189: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:491: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1268: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:901: There were test failures: 368 suites, 1593 tests, 1 error, 40 ignored (6 assumptions)
Total time: 85 minutes 34 seconds
Build step 'Invoke Ant' marked build as failure
Description set: Java: 64bit/jdk1.7.0 -XX:-UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure