You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/12/21 17:23:12 UTC

[JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2008 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2008/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC (asserts: true)

1 tests failed.
FAILED:  org.apache.solr.core.TestDynamicLoading.testDistribSearch

Error Message:
{   "responseHeader":{     "status":404,     "QTime":14},   "error":{     "msg":"no such blob or version available: test/1",     "code":404}} expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>

Stack Trace:
java.lang.AssertionError: {
  "responseHeader":{
    "status":404,
    "QTime":14},
  "error":{
    "msg":"no such blob or version available: test/1",
    "code":404}} expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
	at __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
	at org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 8743 lines...]
   [junit4] Suite: org.apache.solr.core.TestDynamicLoading
   [junit4]   2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/init-core-data-001
   [junit4]   2> 837229 T2316 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 837230 T2316 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 837237 T2316 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 837239 T2316 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 837240 T2317 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 837341 T2316 oasc.ZkTestServer.run start zk server on port:49854
   [junit4]   2> 837345 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 837348 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 837355 T2324 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6e4d3d31 name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 837355 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 837355 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 837356 T2316 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 837365 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 837366 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 837370 T2327 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@36723d68 name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 837370 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 837370 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 837371 T2316 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 837378 T2316 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 837385 T2316 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 837389 T2316 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 837396 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 837397 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 837404 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 837405 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 837412 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 837413 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 837423 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 837423 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 837429 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 837430 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 837436 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 837437 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 837443 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 837444 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 837450 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 837451 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 837457 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 837458 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 837463 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 837463 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 837469 T2316 oasc.AbstractZkTestCase.putConfig put /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 837469 T2316 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 839165 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 839174 T2316 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49857
   [junit4]   2> 839175 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002
   [junit4]   2> 839177 T2316 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/'
   [junit4]   2> 839217 T2316 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/solr.xml
   [junit4]   2> 839240 T2316 oasc.CoreContainer.<init> New CoreContainer 1028334353
   [junit4]   2> 839240 T2316 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/]
   [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 839243 T2316 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 839244 T2316 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 839245 T2316 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 839245 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 839245 T2316 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49854/solr
   [junit4]   2> 839246 T2316 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 839246 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 839248 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 839253 T2339 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12e5b223 name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 839254 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 839255 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 839260 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 839263 T2342 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6406c22 name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 839264 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 839265 T2316 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 839273 T2316 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 839280 T2316 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 839288 T2316 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 839294 T2316 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 839302 T2316 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 839304 T2316 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49857_
   [junit4]   2> 839305 T2316 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49857_
   [junit4]   2> 839311 T2316 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 839313 T2316 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 839317 T2316 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 839322 T2316 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:49857_
   [junit4]   2> 839323 T2316 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 839328 T2316 oasc.Overseer.start Overseer (id=93006854147866627-127.0.0.1:49857_-n_0000000000) starting
   [junit4]   2> 839332 T2316 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 839351 T2316 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 839353 T2344 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 839355 T2316 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 839361 T2316 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 839364 T2316 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 839375 T2343 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 839383 T2346 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 839383 T2346 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 839385 T2346 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 839385 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 839392 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49857",
   [junit4]   2> 	  "node_name":"127.0.0.1:49857_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 0
   [junit4]   2> 839393 T2343 oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49857",
   [junit4]   2> 	  "node_name":"127.0.0.1:49857_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 839393 T2343 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 839394 T2343 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 839395 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 840387 T2346 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 840387 T2346 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 840389 T2346 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 840389 T2346 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 840395 T2346 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 840395 T2346 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/'
   [junit4]   2> 840397 T2346 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 840398 T2346 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 840399 T2346 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 840444 T2346 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 840450 T2346 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 840469 T2346 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 840481 T2346 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 840486 T2346 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 840494 T2346 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 840630 T2346 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 840644 T2346 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 840647 T2346 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 840690 T2346 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 840694 T2346 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 840699 T2346 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 840702 T2346 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 840703 T2346 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 840703 T2346 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 840706 T2346 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 840706 T2346 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 840706 T2346 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 840707 T2346 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 840707 T2346 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/
   [junit4]   2> 840707 T2346 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
   [junit4]   2> 840708 T2346 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data
   [junit4]   2> 840708 T2346 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index/
   [junit4]   2> 840709 T2346 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 840709 T2346 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index
   [junit4]   2> 840710 T2346 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 840710 T2346 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8),segFN=segments_1,generation=1}
   [junit4]   2> 840711 T2346 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 840720 T2346 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 840722 T2346 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 840723 T2346 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 840725 T2346 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 840726 T2346 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 840727 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 840728 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 840729 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 840731 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 840732 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 840747 T2346 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 840749 T2346 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 840750 T2346 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 840752 T2346 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 840757 T2346 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 840758 T2346 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 840758 T2346 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8),segFN=segments_1,generation=1}
   [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 840760 T2346 oass.SolrIndexSearcher.<init> Opening Searcher@4de3bbc[collection1] main
   [junit4]   2> 840760 T2346 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 840763 T2346 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 840763 T2346 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 840764 T2346 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 840765 T2346 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 840765 T2346 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 840768 T2346 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 840768 T2346 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 840770 T2346 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 840776 T2346 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 840776 T2346 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 840776 T2346 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 840776 T2346 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 840778 T2347 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4de3bbc[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 840779 T2346 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 840782 T2350 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49857 collection:control_collection shard:shard1
   [junit4]   2> 840782 T2316 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 840783 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 840783 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 840785 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 840793 T2353 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7d66f1d9 name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 840793 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 840794 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 840796 T2316 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 840798 T2350 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 840805 T2316 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 840805 T2316 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 840807 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 840811 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 840816 T2356 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4d205ac9 name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 840817 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 840817 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 840824 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 840845 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "name":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "stateFormat":2} current state version: 1
   [junit4]   2> 840845 T2343 oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 840860 T2350 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 840879 T2350 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 840880 T2350 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1382 name=collection1 org.apache.solr.core.SolrCore@755e68c7 url=http://127.0.0.1:49857/collection1 node=127.0.0.1:49857_ C1382_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:49857, node_name=127.0.0.1:49857_, state=down}
   [junit4]   2> 840880 T2350 C1382 P49857 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49857/collection1/
   [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncToMe http://127.0.0.1:49857/collection1/ has no replicas
   [junit4]   2> 840881 T2350 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49857/collection1/ shard1
   [junit4]   2> 840881 T2350 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 840884 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 840890 T2343 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
   [junit4]   2> 840897 T2353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 840897 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 840915 T2357 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 840933 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49857",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 2
   [junit4]   2> 840947 T2357 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 841053 T2353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 841127 T2350 oasc.ZkController.register We are http://127.0.0.1:49857/collection1/ and leader is http://127.0.0.1:49857/collection1/
   [junit4]   2> 841127 T2350 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49857
   [junit4]   2> 841127 T2350 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 841130 T2350 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 841132 T2350 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 841139 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 841156 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49857",
   [junit4]   2> 	  "node_name":"127.0.0.1:49857_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 3
   [junit4]   2> 841159 T2343 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49857",
   [junit4]   2> 	  "node_name":"127.0.0.1:49857_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 841276 T2353 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 841276 T2342 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 842764 T2316 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 842765 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 842771 T2316 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49862
   [junit4]   2> 842772 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003
   [junit4]   2> 842773 T2316 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/'
   [junit4]   2> 842810 T2316 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/solr.xml
   [junit4]   2> 842829 T2316 oasc.CoreContainer.<init> New CoreContainer 335265571
   [junit4]   2> 842829 T2316 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/]
   [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 842833 T2316 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 842834 T2316 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 842835 T2316 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 842836 T2316 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 842836 T2316 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 842837 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 842837 T2316 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49854/solr
   [junit4]   2> 842837 T2316 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 842838 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 842839 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 842844 T2369 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f590f35 name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 842845 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 842846 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 842852 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 842859 T2372 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@634dd196 name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 842859 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 842884 T2316 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 843905 T2316 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49862_
   [junit4]   2> 843907 T2316 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49862_
   [junit4]   2> 843919 T2316 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 843934 T2373 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 843934 T2373 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 843941 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 843941 T2373 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 843944 T2373 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 843943 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49862",
   [junit4]   2> 	  "node_name":"127.0.0.1:49862_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 843945 T2373 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 843946 T2343 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49862",
   [junit4]   2> 	  "node_name":"127.0.0.1:49862_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 843950 T2373 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0 
   [junit4]   2> 843950 T2373 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 843952 T2343 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 843953 T2372 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 843955 T2372 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1 
   [junit4]   2> 844953 T2373 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 844954 T2373 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 844957 T2373 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 844957 T2373 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 844964 T2373 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 844965 T2373 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/'
   [junit4]   2> 844967 T2373 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 844968 T2373 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 844969 T2373 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 845009 T2373 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 845015 T2373 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 845033 T2373 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 845046 T2373 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 845049 T2373 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 845056 T2373 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 845191 T2373 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 845206 T2373 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 845207 T2373 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 845244 T2373 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 845249 T2373 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 845253 T2373 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 845256 T2373 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 845258 T2373 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 845258 T2373 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 845262 T2373 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 845262 T2373 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 845263 T2373 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 845263 T2373 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 845263 T2373 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/
   [junit4]   2> 845264 T2373 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
   [junit4]   2> 845264 T2373 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1
   [junit4]   2> 845265 T2373 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index/
   [junit4]   2> 845265 T2373 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 845265 T2373 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index
   [junit4]   2> 845266 T2373 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3),segFN=segments_1,generation=1}
   [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 845275 T2373 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 845281 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 845285 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 845296 T2373 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 845297 T2373 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 845298 T2373 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 845299 T2373 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 845301 T2373 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 845302 T2373 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 845303 T2373 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3),segFN=segments_1,generation=1}
   [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 845304 T2373 oass.SolrIndexSearcher.<init> Opening Searcher@1466a306[collection1] main
   [junit4]   2> 845305 T2373 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 845307 T2373 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 845308 T2373 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 845309 T2373 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 845309 T2373 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 845309 T2373 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 845313 T2373 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 845313 T2373 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 845313 T2373 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 845314 T2373 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 845314 T2373 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 845315 T2374 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1466a306[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 845315 T2373 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 845317 T2377 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49862 collection:collection1 shard:shard2
   [junit4]   2> 845318 T2316 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 845319 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 845320 T2377 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 845338 T2377 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 845345 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 845347 T2377 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 845347 T2377 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1383 name=collection1 org.apache.solr.core.SolrCore@2dc8d5fa url=http://127.0.0.1:49862/collection1 node=127.0.0.1:49862_ C1383_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:49862, node_name=127.0.0.1:49862_, state=down}
   [junit4]   2> 845347 T2377 C1383 P49862 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:49862/collection1/
   [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncToMe http://127.0.0.1:49862/collection1/ has no replicas
   [junit4]   2> 845348 T2377 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:49862/collection1/ shard2
   [junit4]   2> 845348 T2377 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 845349 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"} current state version: 4
   [junit4]   2> 845357 T2343 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 1
   [junit4]   2> 845361 T2372 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 845364 T2372 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2 
   [junit4]   2> 845390 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 845393 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49862",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 4
   [junit4]   2> 845396 T2343 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 2
   [junit4]   2> 845397 T2372 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 845401 T2372 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 845446 T2377 oasc.ZkController.register We are http://127.0.0.1:49862/collection1/ and leader is http://127.0.0.1:49862/collection1/
   [junit4]   2> 845446 T2377 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49862
   [junit4]   2> 845447 T2377 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 845447 T2377 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 845447 T2377 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 845450 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 845455 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49862",
   [junit4]   2> 	  "node_name":"127.0.0.1:49862_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 845459 T2343 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49862",
   [junit4]   2> 	  "node_name":"127.0.0.1:49862_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 845466 T2343 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 3
   [junit4]   2> 845475 T2372 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 845481 T2377 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 845483 T2372 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 847246 T2316 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 847247 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 847252 T2316 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:49865
   [junit4]   2> 847253 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
   [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004
   [junit4]   2> 847255 T2316 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/'
   [junit4]   2> 847309 T2316 oasc.ConfigSolr.fromFile Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/solr.xml
   [junit4]   2> 847325 T2316 oasc.CoreContainer.<init> New CoreContainer 1078127689
   [junit4]   2> 847325 T2316 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/]
   [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 847327 T2316 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 847329 T2316 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 847329 T2316 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 847330 T2316 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 847330 T2316 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 847330 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 847330 T2316 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49854/solr
   [junit4]   2> 847330 T2316 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 847331 T2316 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 847335 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 847336 T2389 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@ece84e9 name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 847338 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 847338 T2316 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 847344 T2316 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 847347 T2392 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@634647ce name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 847347 T2316 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 847362 T2316 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 848381 T2316 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49865_
   [junit4]   2> 848388 T2316 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:49865_
   [junit4]   2> 848403 T2316 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 848422 T2393 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 848422 T2393 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 848428 T2342 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 848429 T2393 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 848429 T2393 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 848431 T2393 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 848432 T2343 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49865",
   [junit4]   2> 	  "node_name":"127.0.0.1:49865_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49865",
   [junit4]   2> 	  "node_name":"127.0.0.1:49865_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 848435 T2393 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 848435 T2343 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 848435 T2393 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 848440 T2343 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 4
   [junit4]   2> 848442 T2392 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 848442 T2372 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 848444 T2392 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 848444 T2372 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 849438 T2393 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 849439 T2393 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 849442 T2393 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 849442 T2393 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 849445 T2393 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 849446 T2393 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/'
   [junit4]   2> 849448 T2393 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 849480 T2393 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 849487 T2393 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 849502 T2393 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 849518 T2393 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 849524 T2393 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 849534 T2393 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 849647 T2393 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 849655 T2393 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 849656 T2393 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 849681 T2393 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 849687 T2393 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 849692 T2393 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 849694 T2393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 849695 T2393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 849696 T2393 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 849698 T2393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 849699 T2393 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 849699 T2393 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 849699 T2393 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 849699 T2393 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/, dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/
   [junit4]   2> 849700 T2393 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
   [junit4]   2> 849700 T2393 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2
   [junit4]   2> 849700 T2393 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index/
   [junit4]   2> 849701 T2393 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 849701 T2393 oasc.CachingDirectoryFactory.get return new directory for /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index
   [junit4]   2> 849701 T2393 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f),segFN=segments_1,generation=1}
   [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 849706 T2393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 849708 T2393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 849709 T2393 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 849712 T2393 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 849714 T2393 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 849716 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 849718 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 849730 T2393 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849731 T2393 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849733 T2393 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849735 T2393 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 849740 T2393 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f),segFN=segments_1,generation=1}
   [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 849742 T2393 oass.SolrIndexSearcher.<init> Opening Searcher@49e1a7c7[collection1] main
   [junit4]   2> 849742 T2393 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 849745 T2393 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 849745 T2393 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 849747 T2393 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 849747 T2393 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 849747 T2393 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 849751 T2393 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 849751 T2393 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 849751 T2393 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 849752 T2393 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 849752 T2393 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 849753 T2393 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 849755 T2397 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:49865 collection:collection1 shard:shard1
   [junit4]   2> 849756 T2394 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@49e1a7c7[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 849756 T2316 oass.SolrDispatchFilter.init user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
   [junit4]   2> 849758 T2316 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 849760 T2397

[...truncated too long message...]

it4]   2> 888022 T2316 oasc.ZkController.unRegisterConfListener  a listener was removed because of core close
   [junit4]   2> 888023 T2316 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
   [junit4]   2> 888023 T2316 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 888023 T2485 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node4",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49872",
   [junit4]   2> 	  "node_name":"127.0.0.1:49872_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 15
   [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 888025 T2485 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node4",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:49872",
   [junit4]   2> 	  "node_name":"127.0.0.1:49872_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 888025 T2316 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 888031 T2485 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 22
   [junit4]   2> 888039 T2316 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 888040 T2316 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index;done=false>>]
   [junit4]   2> 888041 T2316 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index
   [junit4]   2> 888042 T2434 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 888042 T2316 oasc.CachingDirectoryFactory.closeCacheValue looking to close /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4 [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4;done=false>>]
   [junit4]   2> 888043 T2316 oasc.CachingDirectoryFactory.close Closing directory: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4
   [junit4]   2> 888044 T2316 oasc.Overseer.close Overseer (id=93006854147866637-127.0.0.1:49872_-n_0000000004) closing
   [junit4]   2> 888045 T2485 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:49872_
   [junit4]   2> 889547 T2434 oascc.ZkStateReader$7.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 889548 T2475 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 889565 T2316 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 894556 T2316 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 894558 T2316 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49854 49854
   [junit4]   2> 894571 T2317 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:49854 49854
   [junit4]   2> 894790 T2317 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations: 
   [junit4]   2> 	Maximum concurrent create/delete watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		10	/solr/configs/conf1
   [junit4]   2> 		6	/solr/aliases.json
   [junit4]   2> 		6	/solr/clusterstate.json
   [junit4]   2> 		4	/solr/collections/collection1/state.json
   [junit4]   2> 		2	/solr/configs/.system
   [junit4]   2> 	
   [junit4]   2> 	Maximum concurrent children watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		6	/solr/live_nodes
   [junit4]   2> 		5	/solr/overseer/collection-queue-work
   [junit4]   2> 		4	/solr/overseer/queue
   [junit4]   2> 	
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestDynamicLoading -Dtests.method=testDistribSearch -Dtests.seed=CC8AD89B44D0A93D -Dtests.slow=true -Dtests.locale=es_GT -Dtests.timezone=America/Kentucky/Louisville -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 57.8s | TestDynamicLoading.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: {
   [junit4]    >   "responseHeader":{
   [junit4]    >     "status":404,
   [junit4]    >     "QTime":14},
   [junit4]    >   "error":{
   [junit4]    >     "msg":"no such blob or version available: test/1",
   [junit4]    >     "code":404}} expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
   [junit4]    > 	at org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
   [junit4]    > 	at org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 894984 T2316 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001
   [junit4]   2> 57768 T2315 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {blobName=PostingsFormat(name=LuceneVarGapFixedInterval), _version_=PostingsFormat(name=Memory doPackFST= false), id=PostingsFormat(name=Direct), version=PostingsFormat(name=Memory doPackFST= false), timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_GT, timezone=America/Kentucky/Louisville
   [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20 (64-bit)/cpus=2,threads=1,free=139693720,total=288882688
   [junit4]   2> NOTE: All tests run in this JVM: [TestSerializedLuceneMatchVersion, ReplicationFactorTest, RAMDirectoryFactoryTest, TestLRUCache, OutputWriterTest, ZkStateWriterTest, TestInitParams, TestExpandComponent, CoreAdminCreateDiscoverTest, TestCloudSchemaless, MigrateRouteKeyTest, InfoHandlerTest, DisMaxRequestHandlerTest, DistributedFacetPivotSmallTest, HdfsLockFactoryTest, TestPHPSerializedResponseWriter, CursorPagingTest, TestSolrXml, TestClassNameShortening, StressHdfsTest, DistributedFacetPivotSmallAdvancedTest, TestIndexSearcher, LoggingHandlerTest, TestCoreContainer, ExternalCollectionsTest, TestSchemaNameResource, TestBinaryResponseWriter, TestRangeQuery, QueryParsingTest, XmlUpdateRequestHandlerTest, TestAddFieldRealTimeGet, AnalyticsQueryTest, DistribCursorPagingTest, TestRawResponseWriter, ZkSolrClientTest, TestFastWriter, TestDynamicLoading]
   [junit4] Completed in 58.31s, 1 test, 1 failure <<< FAILURES!

[...truncated 1307 lines...]
BUILD FAILED
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1349: The following error occurred while executing this line:
/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956: There were test failures: 453 suites, 1850 tests, 1 failure, 37 ignored (21 assumptions)

Total time: 166 minutes 36 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC (asserts: true)
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2008 - Still Failing!

Posted by Noble Paul <no...@gmail.com>.
Yeah it is.

The data propagation is taking time. I need to fix the tests

On Sun, Dec 21, 2014 at 10:15 PM, Shalin Shekhar Mangar <
shalinmangar@gmail.com> wrote:
>
> This is probably related to SOLR-6787
>
> On Sun, Dec 21, 2014 at 4:23 PM, Policeman Jenkins Server <
> jenkins@thetaphi.de> wrote:
>
>> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2008/
>> Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC (asserts:
>> true)
>>
>> 1 tests failed.
>> FAILED:  org.apache.solr.core.TestDynamicLoading.testDistribSearch
>>
>> Error Message:
>> {   "responseHeader":{     "status":404,     "QTime":14},   "error":{
>>  "msg":"no such blob or version available: test/1",     "code":404}}
>> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>>
>> Stack Trace:
>> java.lang.AssertionError: {
>>   "responseHeader":{
>>     "status":404,
>>     "QTime":14},
>>   "error":{
>>     "msg":"no such blob or version available: test/1",
>>     "code":404}}
>> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>>         at
>> __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
>>         at org.junit.Assert.fail(Assert.java:93)
>>         at org.junit.Assert.failNotEquals(Assert.java:647)
>>         at org.junit.Assert.assertEquals(Assert.java:128)
>>         at
>> org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
>>         at
>> org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
>>         at
>> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
>>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>>         at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>>         at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>>         at java.lang.reflect.Method.invoke(Method.java:483)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>>         at
>> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>>         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>>         at
>> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>>         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
>>         at
>> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>>         at
>> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>>         at
>> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>>         at
>> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>>         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>>         at
>> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
>>         at
>> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>>         at
>> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>>         at
>> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>>         at
>> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>>         at java.lang.Thread.run(Thread.java:745)
>>
>>
>>
>>
>> Build Log:
>> [...truncated 8743 lines...]
>>    [junit4] Suite: org.apache.solr.core.TestDynamicLoading
>>    [junit4]   2> Creating dataDir:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/init-core-data-001
>>    [junit4]   2> 837229 T2316 oas.SolrTestCaseJ4.buildSSLConfig
>> Randomized ssl (false) and clientAuth (false)
>>    [junit4]   2> 837230 T2316
>> oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext
>> system property: /
>>    [junit4]   2> 837237 T2316 oas.SolrTestCaseJ4.setUp ###Starting
>> testDistribSearch
>>    [junit4]   2> 837239 T2316 oasc.ZkTestServer.run STARTING ZK TEST
>> SERVER
>>    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
>>    [junit4]   2> 837240 T2317
>> oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
>>    [junit4]   2> 837341 T2316 oasc.ZkTestServer.run start zk server on
>> port:49854
>>    [junit4]   2> 837345 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 837348 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 837355 T2324 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@6e4d3d31
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 837355 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 837355 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 837356 T2316 oascc.SolrZkClient.makePath makePath: /solr
>>    [junit4]   2> 837365 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 837366 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 837370 T2327 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@36723d68
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 837370 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 837370 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 837371 T2316 oascc.SolrZkClient.makePath makePath:
>> /collections/collection1
>>    [junit4]   2> 837378 T2316 oascc.SolrZkClient.makePath makePath:
>> /collections/collection1/shards
>>    [junit4]   2> 837385 T2316 oascc.SolrZkClient.makePath makePath:
>> /collections/control_collection
>>    [junit4]   2> 837389 T2316 oascc.SolrZkClient.makePath makePath:
>> /collections/control_collection/shards
>>    [junit4]   2> 837396 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
>> to /configs/conf1/solrconfig.xml
>>    [junit4]   2> 837397 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/solrconfig.xml
>>    [junit4]   2> 837404 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml
>> to /configs/conf1/schema.xml
>>    [junit4]   2> 837405 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/schema.xml
>>    [junit4]   2> 837412 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
>> to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>>    [junit4]   2> 837413 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>>    [junit4]   2> 837423 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
>> to /configs/conf1/stopwords.txt
>>    [junit4]   2> 837423 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/stopwords.txt
>>    [junit4]   2> 837429 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt
>> to /configs/conf1/protwords.txt
>>    [junit4]   2> 837430 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/protwords.txt
>>    [junit4]   2> 837436 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml
>> to /configs/conf1/currency.xml
>>    [junit4]   2> 837437 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/currency.xml
>>    [junit4]   2> 837443 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
>> to /configs/conf1/enumsConfig.xml
>>    [junit4]   2> 837444 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/enumsConfig.xml
>>    [junit4]   2> 837450 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
>> to /configs/conf1/open-exchange-rates.json
>>    [junit4]   2> 837451 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/open-exchange-rates.json
>>    [junit4]   2> 837457 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
>> to /configs/conf1/mapping-ISOLatin1Accent.txt
>>    [junit4]   2> 837458 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/mapping-ISOLatin1Accent.txt
>>    [junit4]   2> 837463 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
>> to /configs/conf1/old_synonyms.txt
>>    [junit4]   2> 837463 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/old_synonyms.txt
>>    [junit4]   2> 837469 T2316 oasc.AbstractZkTestCase.putConfig put
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
>> to /configs/conf1/synonyms.txt
>>    [junit4]   2> 837469 T2316 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/synonyms.txt
>>    [junit4]   2> 839165 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>>    [junit4]   2> 839174 T2316 oejs.AbstractConnector.doStart Started
>> SelectChannelConnector@127.0.0.1:49857
>>    [junit4]   2> 839175 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>>    [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
>> not configured for solr (NoInitialContextEx)
>>    [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome
>> using system property solr.solr.home:
>> ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002
>>    [junit4]   2> 839177 T2316 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/'
>>    [junit4]   2> 839217 T2316 oasc.ConfigSolr.fromFile Loading container
>> configuration from
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/solr.xml
>>    [junit4]   2> 839240 T2316 oasc.CoreContainer.<init> New CoreContainer
>> 1028334353
>>    [junit4]   2> 839240 T2316 oasc.CoreContainer.load Loading cores into
>> CoreContainer
>> [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/]
>>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting socketTimeout to: 90000
>>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting urlScheme to:
>>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting connTimeout to: 15000
>>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnectionsPerHost to: 20
>>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnections to: 10000
>>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting corePoolSize to: 0
>>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maximumPoolSize to: 2147483647
>>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxThreadIdleTime to: 5
>>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting sizeOfQueue to: -1
>>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting fairnessPolicy to: false
>>    [junit4]   2> 839243 T2316 oasu.UpdateShardHandler.<init> Creating
>> UpdateShardHandler HTTP client with params:
>> socketTimeout=340000&connTimeout=45000&retry=false
>>    [junit4]   2> 839244 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
>> org.slf4j.impl.Log4jLoggerFactory
>>    [junit4]   2> 839245 T2316 oasl.LogWatcher.newRegisteredLogWatcher
>> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>>    [junit4]   2> 839245 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>>    [junit4]   2> 839245 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
>> client=127.0.0.1:49854/solr
>>    [junit4]   2> 839246 T2316 oasc.ZkController.checkChrootPath zkHost
>> includes chroot
>>    [junit4]   2> 839246 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 839248 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 839253 T2339 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@12e5b223
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 839254 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 839255 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 839260 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 839263 T2342 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@6406c22
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 839264 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 839265 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/queue
>>    [junit4]   2> 839273 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-queue-work
>>    [junit4]   2> 839280 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-map-running
>>    [junit4]   2> 839288 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-map-completed
>>    [junit4]   2> 839294 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/collection-map-failure
>>    [junit4]   2> 839302 T2316 oascc.SolrZkClient.makePath makePath:
>> /live_nodes
>>    [junit4]   2> 839304 T2316 oasc.ZkController.createEphemeralLiveNode
>> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49857_
>>    [junit4]   2> 839305 T2316 oascc.SolrZkClient.makePath makePath:
>> /live_nodes/127.0.0.1:49857_
>>    [junit4]   2> 839311 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer_elect
>>    [junit4]   2> 839313 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer_elect/election
>>    [junit4]   2> 839317 T2316 oasc.Overseer.close Overseer (id=null)
>> closing
>>    [junit4]   2> 839322 T2316
>> oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader
>> 127.0.0.1:49857_
>>    [junit4]   2> 839323 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer_elect/leader
>>    [junit4]   2> 839328 T2316 oasc.Overseer.start Overseer
>> (id=93006854147866627-127.0.0.1:49857_-n_0000000000) starting
>>    [junit4]   2> 839332 T2316 oascc.SolrZkClient.makePath makePath:
>> /overseer/queue-work
>>    [junit4]   2> 839351 T2316
>> oasc.OverseerAutoReplicaFailoverThread.<init> Starting
>> OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000
>> autoReplicaFailoverWaitAfterExpiration=30000
>> autoReplicaFailoverBadNodeExpiration=60000
>>    [junit4]   2> 839353 T2344 oasc.OverseerCollectionProcessor.run
>> Process current queue of collection creations
>>    [junit4]   2> 839355 T2316 oascc.SolrZkClient.makePath makePath:
>> /clusterstate.json
>>    [junit4]   2> 839361 T2316 oascc.SolrZkClient.makePath makePath:
>> /aliases.json
>>    [junit4]   2> 839364 T2316
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 839375 T2343 oasc.Overseer$ClusterStateUpdater.run
>> Starting to work on the main queue
>>    [junit4]   2> 839383 T2346 oasc.ZkController.publish publishing
>> core=collection1 state=down collection=control_collection
>>    [junit4]   2> 839383 T2346 oasc.ZkController.publish numShards not
>> found on descriptor - reading it from system property
>>    [junit4]   2> 839385 T2346 oasc.ZkController.waitForCoreNodeName look
>> for our core node name
>>    [junit4]   2> 839385 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 839392 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 0, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>>    [junit4]   2>          "numShards":"1",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"control_collection",
>>    [junit4]   2>          "operation":"state"} current state version: 0
>>    [junit4]   2> 839393 T2343 oasco.ReplicaMutator.updateState Update
>> state numShards=1 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>>    [junit4]   2>          "numShards":"1",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"control_collection",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 839393 T2343 oasco.ClusterStateMutator.createCollection
>> building a new cName: control_collection
>>    [junit4]   2> 839394 T2343 oasco.ReplicaMutator.updateState Assigning
>> new node to shard shard=shard1
>>    [junit4]   2> 839395 T2342 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 840387 T2346 oasc.ZkController.waitForShardId waiting to
>> find shard id in clusterstate for collection1
>>    [junit4]   2> 840387 T2346 oasc.ZkController.createCollectionZkNode
>> Check for collection zkNode:control_collection
>>    [junit4]   2> 840389 T2346 oasc.ZkController.createCollectionZkNode
>> Collection zkNode exists
>>    [junit4]   2> 840389 T2346 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/control_collection
>>    [junit4]   2> 840395 T2346 oascc.ZkStateReader.readConfigName
>> path=/collections/control_collection configName=conf1 specified config
>> exists in ZooKeeper
>>    [junit4]   2> 840395 T2346 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/'
>>    [junit4]   2> 840397 T2346 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/.svn/'
>> to classloader
>>    [junit4]   2> 840398 T2346 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/classes/'
>> to classloader
>>    [junit4]   2> 840399 T2346 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/README'
>> to classloader
>>    [junit4]   2> 840444 T2346 oasc.ZkController.watchZKConfDir watch
>> zkdir /configs/conf1
>>    [junit4]   2> 840450 T2346 oasc.Config.<init> loaded config
>> solrconfig.xml with version 0
>>    [junit4]   2> 840469 T2346 oasc.SolrConfig.<init> Using Lucene
>> MatchVersion: 6.0.0
>>    [junit4]   2> 840481 T2346 oasc.SolrConfig.<init> Loaded SolrConfig:
>> solrconfig.xml
>>    [junit4]   2> 840486 T2346 oass.IndexSchema.readSchema Reading Solr
>> Schema from /configs/conf1/schema.xml
>>    [junit4]   2> 840494 T2346 oass.IndexSchema.readSchema [collection1]
>> Schema name=test
>>    [junit4]   2> 840630 T2346 oass.OpenExchangeRatesOrgProvider.init
>> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>>    [junit4]   2> 840644 T2346 oass.IndexSchema.readSchema default search
>> field in schema is text
>>    [junit4]   2> 840647 T2346 oass.IndexSchema.readSchema unique key
>> field: id
>>    [junit4]   2> 840690 T2346 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 840694 T2346 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 840699 T2346 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 840702 T2346
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 840703 T2346
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 840703 T2346 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 840706 T2346
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 840706 T2346
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 840706 T2346 oasc.CoreContainer.create Creating SolrCore
>> 'collection1' using configuration from collection control_collection
>>    [junit4]   2> 840707 T2346 oasc.SolrCore.initDirectoryFactory
>> org.apache.solr.core.MockDirectoryFactory
>>    [junit4]   2> 840707 T2346 oasc.SolrCore.<init> [collection1] Opening
>> new SolrCore at
>> ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/,
>> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/
>>    [junit4]   2> 840707 T2346 oasc.JmxMonitoredMap.<init> JMX monitoring
>> is enabled. Adding Solr mbeans to JMX Server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>>    [junit4]   2> 840708 T2346 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data
>>    [junit4]   2> 840708 T2346 oasc.SolrCore.getNewIndexDir New index
>> directory detected: old=null
>> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index/
>>    [junit4]   2> 840709 T2346 oasc.SolrCore.initIndex WARN [collection1]
>> Solr index directory
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index'
>> doesn't exist. Creating new index...
>>    [junit4]   2> 840709 T2346 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index
>>    [junit4]   2> 840710 T2346 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 840710 T2346 oasc.SolrDeletionPolicy.onCommit
>> SolrDeletionPolicy.onCommit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 840711 T2346 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "nodistrib"
>>    [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>>    [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 840720 T2346 oasc.SolrCore.loadUpdateProcessorChains no
>> updateRequestProcessorChain defined as default, creating implicit default
>>    [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /update: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 840722 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 840723 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /config: org.apache.solr.handler.SolrConfigHandler
>>    [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /schema: org.apache.solr.handler.SchemaHandler
>>    [junit4]   2> 840725 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /replication: org.apache.solr.handler.ReplicationHandler
>>    [junit4]   2> 840726 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /get: org.apache.solr.handler.RealTimeGetHandler
>>    [junit4]   2> 840727 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>>    [junit4]   2> 840728 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>>    [junit4]   2> 840729 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>>    [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>>    [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>>    [junit4]   2> 840731 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/properties:
>> org.apache.solr.handler.admin.PropertiesRequestHandler
>>    [junit4]   2> 840732 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>>    [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>>    [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created standard: solr.StandardRequestHandler
>>    [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/file: solr.admin.ShowFileRequestHandler
>>    [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/fileedit: solr.admin.EditFileRequestHandler
>>    [junit4]   2> 840747 T2346 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 840749 T2346 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 840750 T2346 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 840752 T2346 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 840757 T2346 oasu.CommitTracker.<init> Hard AutoCommit:
>> disabled
>>    [junit4]   2> 840758 T2346 oasu.CommitTracker.<init> Soft AutoCommit:
>> disabled
>>    [junit4]   2> 840758 T2346 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.onInit
>> SolrDeletionPolicy.onInit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 840760 T2346 oass.SolrIndexSearcher.<init> Opening
>> Searcher@4de3bbc[collection1] main
>>    [junit4]   2> 840760 T2346 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/control_collection
>>    [junit4]   2> 840763 T2346 oascc.ZkStateReader.readConfigName
>> path=/collections/control_collection configName=conf1 specified config
>> exists in ZooKeeper
>>    [junit4]   2> 840763 T2346 oasr.ManagedResourceStorage.newStorageIO
>> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
>> /configs/conf1
>>    [junit4]   2> 840764 T2346
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
>> ZooKeeperStorageIO with znodeBase: /configs/conf1
>>    [junit4]   2> 840765 T2346 oasr.RestManager.init Initializing
>> RestManager with initArgs: {}
>>    [junit4]   2> 840765 T2346 oasr.ManagedResourceStorage.load Reading
>> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 840768 T2346
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data
>> found for znode /configs/conf1/_rest_managed.json
>>    [junit4]   2> 840768 T2346 oasr.ManagedResourceStorage.load Loaded
>> null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 840770 T2346 oascc.SolrZkClient.makePath makePath:
>> /configs/conf1/_rest_managed.json
>>    [junit4]   2> 840776 T2346
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to
>> new znode /configs/conf1/_rest_managed.json
>>    [junit4]   2> 840776 T2346
>> oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path
>> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 840776 T2346 oasr.RestManager.init Initializing 0
>> registered ManagedResources
>>    [junit4]   2> 840776 T2346 oash.ReplicationHandler.inform Commits will
>> be reserved for  10000
>>    [junit4]   2> 840778 T2347 oasc.SolrCore.registerSearcher
>> [collection1] Registered new searcher Searcher@4de3bbc[collection1]
>> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>>    [junit4]   2> 840779 T2346 oasc.CoreContainer.registerCore registering
>> core: collection1
>>    [junit4]   2> 840782 T2350 oasc.ZkController.register Register replica
>> - core:collection1 address:http://127.0.0.1:49857
>> collection:control_collection shard:shard1
>>    [junit4]   2> 840782 T2316 oass.SolrDispatchFilter.init
>> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>>    [junit4]   2> 840783 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init() done
>>    [junit4]   2> 840783 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 840785 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 840793 T2353 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@7d66f1d9
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 840793 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 840794 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 840796 T2316
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 840798 T2350 oascc.SolrZkClient.makePath makePath:
>> /collections/control_collection/leader_elect/shard1/election
>>    [junit4]   2> 840805 T2316 oasc.ChaosMonkey.monkeyLog monkey: init -
>> expire sessions:false cause connection loss:false
>>    [junit4]   2> 840805 T2316
>> oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with
>> stateFormat=2
>>    [junit4]   2> 840807 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 840811 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 840816 T2356 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@4d205ac9
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 840817 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 840817 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 840824 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 840845 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "operation":"create",
>>    [junit4]   2>          "name":"collection1",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "stateFormat":2} current state version: 1
>>    [junit4]   2> 840845 T2343 oasco.ClusterStateMutator.createCollection
>> building a new cName: collection1
>>    [junit4]   2> 840860 T2350
>> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process
>> for shard shard1
>>    [junit4]   2> 840879 T2350
>> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
>> found to continue.
>>    [junit4]   2> 840880 T2350
>> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader -
>> try and sync
>>    [junit4]   2> ASYNC  NEW_CORE C1382 name=collection1
>> org.apache.solr.core.SolrCore@755e68c7 url=
>> http://127.0.0.1:49857/collection1 node=127.0.0.1:49857_
>> C1382_STATE=coll:control_collection core:collection1
>> props:{core=collection1, base_url=http://127.0.0.1:49857,
>> node_name=127.0.0.1:49857_, state=down}
>>    [junit4]   2> 840880 T2350 C1382 P49857 oasc.SyncStrategy.sync Sync
>> replicas to http://127.0.0.1:49857/collection1/
>>    [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncReplicas
>> Sync Success - now sync replicas to me
>>    [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncToMe
>> http://127.0.0.1:49857/collection1/ has no replicas
>>    [junit4]   2> 840881 T2350
>> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
>> http://127.0.0.1:49857/collection1/ shard1
>>    [junit4]   2> 840881 T2350 oascc.SolrZkClient.makePath makePath:
>> /collections/control_collection/leaders/shard1
>>    [junit4]   2> 840884 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "operation":"leader",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"control_collection"} current
>> state version: 1
>>    [junit4]   2> 840890 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to create_collection /collections/collection1/state.json
>>    [junit4]   2> 840897 T2353 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 840897 T2342 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 840915 T2357 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 840933 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "operation":"leader",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"control_collection",
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "state":"active"} current state version: 2
>>    [junit4]   2> 840947 T2357 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 841053 T2353 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 841127 T2350 oasc.ZkController.register We are
>> http://127.0.0.1:49857/collection1/ and leader is
>> http://127.0.0.1:49857/collection1/
>>    [junit4]   2> 841127 T2350 oasc.ZkController.register No LogReplay
>> needed for core=collection1 baseURL=http://127.0.0.1:49857
>>    [junit4]   2> 841127 T2350 oasc.ZkController.checkRecovery I am the
>> leader, no recovery necessary
>>    [junit4]   2> 841130 T2350 oasc.ZkController.publish publishing
>> core=collection1 state=active collection=control_collection
>>    [junit4]   2> 841132 T2350 oasc.ZkController.publish numShards not
>> found on descriptor - reading it from system property
>>    [junit4]   2> 841139 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 841156 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"active",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"control_collection",
>>    [junit4]   2>          "operation":"state"} current state version: 3
>>    [junit4]   2> 841159 T2343 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"active",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"control_collection",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 841276 T2353 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 841276 T2342 oascc.ZkStateReader$2.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>>    [junit4]   2> 842764 T2316
>> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
>>    [junit4]   2> 842765 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>>    [junit4]   2> 842771 T2316 oejs.AbstractConnector.doStart Started
>> SelectChannelConnector@127.0.0.1:49862
>>    [junit4]   2> 842772 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>>    [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
>> not configured for solr (NoInitialContextEx)
>>    [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome
>> using system property solr.solr.home:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003
>>    [junit4]   2> 842773 T2316 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/'
>>    [junit4]   2> 842810 T2316 oasc.ConfigSolr.fromFile Loading container
>> configuration from
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/solr.xml
>>    [junit4]   2> 842829 T2316 oasc.CoreContainer.<init> New CoreContainer
>> 335265571
>>    [junit4]   2> 842829 T2316 oasc.CoreContainer.load Loading cores into
>> CoreContainer
>> [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/]
>>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting socketTimeout to: 90000
>>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting urlScheme to:
>>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting connTimeout to: 15000
>>    [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnectionsPerHost to: 20
>>    [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnections to: 10000
>>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting corePoolSize to: 0
>>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maximumPoolSize to: 2147483647
>>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxThreadIdleTime to: 5
>>    [junit4]   2> 842833 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting sizeOfQueue to: -1
>>    [junit4]   2> 842834 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting fairnessPolicy to: false
>>    [junit4]   2> 842835 T2316 oasu.UpdateShardHandler.<init> Creating
>> UpdateShardHandler HTTP client with params:
>> socketTimeout=340000&connTimeout=45000&retry=false
>>    [junit4]   2> 842836 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
>> org.slf4j.impl.Log4jLoggerFactory
>>    [junit4]   2> 842836 T2316 oasl.LogWatcher.newRegisteredLogWatcher
>> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>>    [junit4]   2> 842837 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>>    [junit4]   2> 842837 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
>> client=127.0.0.1:49854/solr
>>    [junit4]   2> 842837 T2316 oasc.ZkController.checkChrootPath zkHost
>> includes chroot
>>    [junit4]   2> 842838 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 842839 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 842844 T2369 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@7f590f35
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 842845 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 842846 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 842852 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 842859 T2372 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@634dd196
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 842859 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 842884 T2316
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 843905 T2316 oasc.ZkController.createEphemeralLiveNode
>> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49862_
>>    [junit4]   2> 843907 T2316 oascc.SolrZkClient.makePath makePath:
>> /live_nodes/127.0.0.1:49862_
>>    [junit4]   2> 843919 T2316 oasc.Overseer.close Overseer (id=null)
>> closing
>>    [junit4]   2> 843934 T2373 oasc.ZkController.publish publishing
>> core=collection1 state=down collection=collection1
>>    [junit4]   2> 843934 T2373 oasc.ZkController.publish numShards not
>> found on descriptor - reading it from system property
>>    [junit4]   2> 843941 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 843941 T2373 oasc.ZkController.preRegister Registering
>> watch for external collection collection1
>>    [junit4]   2> 843944 T2373 oascc.ZkStateReader.addZkWatch addZkWatch
>> collection1
>>    [junit4]   2> 843943 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"} current state version: 4
>>    [junit4]   2> 843945 T2373 oascc.ZkStateReader.addZkWatch Updating
>> collection state at /collections/collection1/state.json from ZooKeeper...
>>    [junit4]   2> 843946 T2343 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Collection
>> already exists with numShards=2
>>    [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Assigning
>> new node to shard shard=shard2
>>    [junit4]   2> 843950 T2373 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 0
>>    [junit4]   2> 843950 T2373 oasc.ZkController.waitForCoreNodeName look
>> for our core node name
>>    [junit4]   2> 843952 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 0
>>    [junit4]   2> 843953 T2372 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 843955 T2372 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 1
>>    [junit4]   2> 844953 T2373 oasc.ZkController.waitForShardId waiting to
>> find shard id in clusterstate for collection1
>>    [junit4]   2> 844954 T2373 oasc.ZkController.createCollectionZkNode
>> Check for collection zkNode:collection1
>>    [junit4]   2> 844957 T2373 oasc.ZkController.createCollectionZkNode
>> Collection zkNode exists
>>    [junit4]   2> 844957 T2373 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/collection1
>>    [junit4]   2> 844964 T2373 oascc.ZkStateReader.readConfigName
>> path=/collections/collection1 configName=conf1 specified config exists in
>> ZooKeeper
>>    [junit4]   2> 844965 T2373 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/'
>>    [junit4]   2> 844967 T2373 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/.svn/'
>> to classloader
>>    [junit4]   2> 844968 T2373 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/classes/'
>> to classloader
>>    [junit4]   2> 844969 T2373 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/README'
>> to classloader
>>    [junit4]   2> 845009 T2373 oasc.ZkController.watchZKConfDir watch
>> zkdir /configs/conf1
>>    [junit4]   2> 845015 T2373 oasc.Config.<init> loaded config
>> solrconfig.xml with version 0
>>    [junit4]   2> 845033 T2373 oasc.SolrConfig.<init> Using Lucene
>> MatchVersion: 6.0.0
>>    [junit4]   2> 845046 T2373 oasc.SolrConfig.<init> Loaded SolrConfig:
>> solrconfig.xml
>>    [junit4]   2> 845049 T2373 oass.IndexSchema.readSchema Reading Solr
>> Schema from /configs/conf1/schema.xml
>>    [junit4]   2> 845056 T2373 oass.IndexSchema.readSchema [collection1]
>> Schema name=test
>>    [junit4]   2> 845191 T2373 oass.OpenExchangeRatesOrgProvider.init
>> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>>    [junit4]   2> 845206 T2373 oass.IndexSchema.readSchema default search
>> field in schema is text
>>    [junit4]   2> 845207 T2373 oass.IndexSchema.readSchema unique key
>> field: id
>>    [junit4]   2> 845244 T2373 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 845249 T2373 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 845253 T2373 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 845256 T2373
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 845258 T2373
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 845258 T2373 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 845262 T2373
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 845262 T2373
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 845263 T2373 oasc.CoreContainer.create Creating SolrCore
>> 'collection1' using configuration from collection collection1
>>    [junit4]   2> 845263 T2373 oasc.SolrCore.initDirectoryFactory
>> org.apache.solr.core.MockDirectoryFactory
>>    [junit4]   2> 845263 T2373 oasc.SolrCore.<init> [collection1] Opening
>> new SolrCore at
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/,
>> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/
>>    [junit4]   2> 845264 T2373 oasc.JmxMonitoredMap.<init> JMX monitoring
>> is enabled. Adding Solr mbeans to JMX Server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>>    [junit4]   2> 845264 T2373 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1
>>    [junit4]   2> 845265 T2373 oasc.SolrCore.getNewIndexDir New index
>> directory detected: old=null
>> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index/
>>    [junit4]   2> 845265 T2373 oasc.SolrCore.initIndex WARN [collection1]
>> Solr index directory
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index'
>> doesn't exist. Creating new index...
>>    [junit4]   2> 845265 T2373 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index
>>    [junit4]   2> 845266 T2373 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.onCommit
>> SolrDeletionPolicy.onCommit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "nodistrib"
>>    [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>>    [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 845275 T2373 oasc.SolrCore.loadUpdateProcessorChains no
>> updateRequestProcessorChain defined as default, creating implicit default
>>    [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /update: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /config: org.apache.solr.handler.SolrConfigHandler
>>    [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /schema: org.apache.solr.handler.SchemaHandler
>>    [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /replication: org.apache.solr.handler.ReplicationHandler
>>    [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /get: org.apache.solr.handler.RealTimeGetHandler
>>    [junit4]   2> 845281 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>>    [junit4]   2> 845285 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>>    [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>>    [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/properties:
>> org.apache.solr.handler.admin.PropertiesRequestHandler
>>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>>    [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>>    [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created standard: solr.StandardRequestHandler
>>    [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/file: solr.admin.ShowFileRequestHandler
>>    [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/fileedit: solr.admin.EditFileRequestHandler
>>    [junit4]   2> 845296 T2373 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 845297 T2373 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 845298 T2373 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 845299 T2373 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 845301 T2373 oasu.CommitTracker.<init> Hard AutoCommit:
>> disabled
>>    [junit4]   2> 845302 T2373 oasu.CommitTracker.<init> Soft AutoCommit:
>> disabled
>>    [junit4]   2> 845303 T2373 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.onInit
>> SolrDeletionPolicy.onInit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 845304 T2373 oass.SolrIndexSearcher.<init> Opening
>> Searcher@1466a306[collection1] main
>>    [junit4]   2> 845305 T2373 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/collection1
>>    [junit4]   2> 845307 T2373 oascc.ZkStateReader.readConfigName
>> path=/collections/collection1 configName=conf1 specified config exists in
>> ZooKeeper
>>    [junit4]   2> 845308 T2373 oasr.ManagedResourceStorage.newStorageIO
>> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
>> /configs/conf1
>>    [junit4]   2> 845309 T2373
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
>> ZooKeeperStorageIO with znodeBase: /configs/conf1
>>    [junit4]   2> 845309 T2373 oasr.RestManager.init Initializing
>> RestManager with initArgs: {}
>>    [junit4]   2> 845309 T2373 oasr.ManagedResourceStorage.load Reading
>> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 845313 T2373
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38
>> bytes from znode /configs/conf1/_rest_managed.json
>>    [junit4]   2> 845313 T2373 oasr.ManagedResourceStorage.load Loaded
>> LinkedHashMap at path _rest_managed.json using
>> ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 845313 T2373 oasr.ManagedResource.reloadFromStorage
>> Loaded initArgs {} for /rest/managed
>>    [junit4]   2> 845314 T2373 oasr.RestManager.init Initializing 0
>> registered ManagedResources
>>    [junit4]   2> 845314 T2373 oash.ReplicationHandler.inform Commits will
>> be reserved for  10000
>>    [junit4]   2> 845315 T2374 oasc.SolrCore.registerSearcher
>> [collection1] Registered new searcher Searcher@1466a306[collection1]
>> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>>    [junit4]   2> 845315 T2373 oasc.CoreContainer.registerCore registering
>> core: collection1
>>    [junit4]   2> 845317 T2377 oasc.ZkController.register Register replica
>> - core:collection1 address:http://127.0.0.1:49862 collection:collection1
>> shard:shard2
>>    [junit4]   2> 845318 T2316 oass.SolrDispatchFilter.init
>> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>>    [junit4]   2> 845319 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init() done
>>    [junit4]   2> 845320 T2377 oascc.SolrZkClient.makePath makePath:
>> /collections/collection1/leader_elect/shard2/election
>>    [junit4]   2> 845338 T2377
>> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process
>> for shard shard2
>>    [junit4]   2> 845345 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 845347 T2377
>> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
>> found to continue.
>>    [junit4]   2> 845347 T2377
>> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader -
>> try and sync
>>    [junit4]   2> ASYNC  NEW_CORE C1383 name=collection1
>> org.apache.solr.core.SolrCore@2dc8d5fa url=
>> http://127.0.0.1:49862/collection1 node=127.0.0.1:49862_
>> C1383_STATE=coll:collection1 core:collection1 props:{core=collection1,
>> base_url=http://127.0.0.1:49862, node_name=127.0.0.1:49862_, state=down}
>>    [junit4]   2> 845347 T2377 C1383 P49862 oasc.SyncStrategy.sync Sync
>> replicas to http://127.0.0.1:49862/collection1/
>>    [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncReplicas
>> Sync Success - now sync replicas to me
>>    [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncToMe
>> http://127.0.0.1:49862/collection1/ has no replicas
>>    [junit4]   2> 845348 T2377
>> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
>> http://127.0.0.1:49862/collection1/ shard2
>>    [junit4]   2> 845348 T2377 oascc.SolrZkClient.makePath makePath:
>> /collections/collection1/leaders/shard2
>>    [junit4]   2> 845349 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "operation":"leader",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"collection1"} current state
>> version: 4
>>    [junit4]   2> 845357 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 1
>>    [junit4]   2> 845361 T2372 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 845364 T2372 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 2
>>    [junit4]   2> 845390 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 845393 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "operation":"leader",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "state":"active"} current state version: 4
>>    [junit4]   2> 845396 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 2
>>    [junit4]   2> 845397 T2372 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 845401 T2372 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 3
>>    [junit4]   2> 845446 T2377 oasc.ZkController.register We are
>> http://127.0.0.1:49862/collection1/ and leader is
>> http://127.0.0.1:49862/collection1/
>>    [junit4]   2> 845446 T2377 oasc.ZkController.register No LogReplay
>> needed for core=collection1 baseURL=http://127.0.0.1:49862
>>    [junit4]   2> 845447 T2377 oasc.ZkController.checkRecovery I am the
>> leader, no recovery necessary
>>    [junit4]   2> 845447 T2377 oasc.ZkController.publish publishing
>> core=collection1 state=active collection=collection1
>>    [junit4]   2> 845447 T2377 oasc.ZkController.publish numShards not
>> found on descriptor - reading it from system property
>>    [junit4]   2> 845450 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 845455 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"active",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"} current state version: 4
>>    [junit4]   2> 845459 T2343 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"active",
>>    [junit4]   2>          "shard":"shard2",
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 845466 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 3
>>    [junit4]   2> 845475 T2372 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 845481 T2377 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 4
>>    [junit4]   2> 845483 T2372 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 4
>>    [junit4]   2> 847246 T2316
>> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
>>    [junit4]   2> 847247 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>>    [junit4]   2> 847252 T2316 oejs.AbstractConnector.doStart Started
>> SelectChannelConnector@127.0.0.1:49865
>>    [junit4]   2> 847253 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>>    [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
>> not configured for solr (NoInitialContextEx)
>>    [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome
>> using system property solr.solr.home:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004
>>    [junit4]   2> 847255 T2316 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/'
>>    [junit4]   2> 847309 T2316 oasc.ConfigSolr.fromFile Loading container
>> configuration from
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/solr.xml
>>    [junit4]   2> 847325 T2316 oasc.CoreContainer.<init> New CoreContainer
>> 1078127689
>>    [junit4]   2> 847325 T2316 oasc.CoreContainer.load Loading cores into
>> CoreContainer
>> [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/]
>>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting socketTimeout to: 90000
>>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting urlScheme to:
>>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting connTimeout to: 15000
>>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnectionsPerHost to: 20
>>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxConnections to: 10000
>>    [junit4]   2> 847327 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting corePoolSize to: 0
>>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maximumPoolSize to: 2147483647
>>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting maxThreadIdleTime to: 5
>>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting sizeOfQueue to: -1
>>    [junit4]   2> 847329 T2316 oashc.HttpShardHandlerFactory.getParameter
>> Setting fairnessPolicy to: false
>>    [junit4]   2> 847329 T2316 oasu.UpdateShardHandler.<init> Creating
>> UpdateShardHandler HTTP client with params:
>> socketTimeout=340000&connTimeout=45000&retry=false
>>    [junit4]   2> 847330 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
>> org.slf4j.impl.Log4jLoggerFactory
>>    [junit4]   2> 847330 T2316 oasl.LogWatcher.newRegisteredLogWatcher
>> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>>    [junit4]   2> 847330 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>>    [junit4]   2> 847330 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
>> client=127.0.0.1:49854/solr
>>    [junit4]   2> 847330 T2316 oasc.ZkController.checkChrootPath zkHost
>> includes chroot
>>    [junit4]   2> 847331 T2316
>> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
>> ZkCredentialsProvider
>>    [junit4]   2> 847335 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 847336 T2389 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@ece84e9
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
>> state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 847338 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 847338 T2316 oascc.SolrZkClient.createZkACLProvider
>> Using default ZkACLProvider
>>    [junit4]   2> 847344 T2316 oascc.ConnectionManager.waitForConnected
>> Waiting for client to connect to ZooKeeper
>>    [junit4]   2> 847347 T2392 oascc.ConnectionManager.process Watcher
>> org.apache.solr.common.cloud.ConnectionManager@634647ce
>> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
>> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>>    [junit4]   2> 847347 T2316 oascc.ConnectionManager.waitForConnected
>> Client is connected to ZooKeeper
>>    [junit4]   2> 847362 T2316
>> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
>> state from ZooKeeper...
>>    [junit4]   2> 848381 T2316 oasc.ZkController.createEphemeralLiveNode
>> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49865_
>>    [junit4]   2> 848388 T2316 oascc.SolrZkClient.makePath makePath:
>> /live_nodes/127.0.0.1:49865_
>>    [junit4]   2> 848403 T2316 oasc.Overseer.close Overseer (id=null)
>> closing
>>    [junit4]   2> 848422 T2393 oasc.ZkController.publish publishing
>> core=collection1 state=down collection=collection1
>>    [junit4]   2> 848422 T2393 oasc.ZkController.publish numShards not
>> found on descriptor - reading it from system property
>>    [junit4]   2> 848428 T2342 oasc.DistributedQueue$LatchWatcher.process
>> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>>    [junit4]   2> 848429 T2393 oasc.ZkController.preRegister Registering
>> watch for external collection collection1
>>    [junit4]   2> 848429 T2393 oascc.ZkStateReader.addZkWatch addZkWatch
>> collection1
>>    [junit4]   2> 848431 T2393 oascc.ZkStateReader.addZkWatch Updating
>> collection state at /collections/collection1/state.json from ZooKeeper...
>>    [junit4]   2> 848432 T2343 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49865",
>>    [junit4]   2>          "node_name":"127.0.0.1:49865_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"} current state version: 4
>>    [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49865",
>>    [junit4]   2>          "node_name":"127.0.0.1:49865_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":null,
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Collection
>> already exists with numShards=2
>>    [junit4]   2> 848435 T2393 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 4
>>    [junit4]   2> 848435 T2343 oasco.ReplicaMutator.updateState Assigning
>> new node to shard shard=shard1
>>    [junit4]   2> 848435 T2393 oasc.ZkController.waitForCoreNodeName look
>> for our core node name
>>    [junit4]   2> 848440 T2343 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 4
>>    [junit4]   2> 848442 T2392 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 848442 T2372 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 848444 T2392 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 5
>>    [junit4]   2> 848444 T2372 oascc.ZkStateReader.updateWatchedCollection
>> Updating data for collection1 to ver 5
>>    [junit4]   2> 849438 T2393 oasc.ZkController.waitForShardId waiting to
>> find shard id in clusterstate for collection1
>>    [junit4]   2> 849439 T2393 oasc.ZkController.createCollectionZkNode
>> Check for collection zkNode:collection1
>>    [junit4]   2> 849442 T2393 oasc.ZkController.createCollectionZkNode
>> Collection zkNode exists
>>    [junit4]   2> 849442 T2393 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/collection1
>>    [junit4]   2> 849445 T2393 oascc.ZkStateReader.readConfigName
>> path=/collections/collection1 configName=conf1 specified config exists in
>> ZooKeeper
>>    [junit4]   2> 849446 T2393 oasc.SolrResourceLoader.<init> new
>> SolrResourceLoader for directory:
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/'
>>    [junit4]   2> 849448 T2393 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/.svn/'
>> to classloader
>>    [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/classes/'
>> to classloader
>>    [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader
>> Adding
>> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/README'
>> to classloader
>>    [junit4]   2> 849480 T2393 oasc.ZkController.watchZKConfDir watch
>> zkdir /configs/conf1
>>    [junit4]   2> 849487 T2393 oasc.Config.<init> loaded config
>> solrconfig.xml with version 0
>>    [junit4]   2> 849502 T2393 oasc.SolrConfig.<init> Using Lucene
>> MatchVersion: 6.0.0
>>    [junit4]   2> 849518 T2393 oasc.SolrConfig.<init> Loaded SolrConfig:
>> solrconfig.xml
>>    [junit4]   2> 849524 T2393 oass.IndexSchema.readSchema Reading Solr
>> Schema from /configs/conf1/schema.xml
>>    [junit4]   2> 849534 T2393 oass.IndexSchema.readSchema [collection1]
>> Schema name=test
>>    [junit4]   2> 849647 T2393 oass.OpenExchangeRatesOrgProvider.init
>> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>>    [junit4]   2> 849655 T2393 oass.IndexSchema.readSchema default search
>> field in schema is text
>>    [junit4]   2> 849656 T2393 oass.IndexSchema.readSchema unique key
>> field: id
>>    [junit4]   2> 849681 T2393 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 849687 T2393 oass.FileExchangeRateProvider.reload
>> Reloading exchange rates from file currency.xml
>>    [junit4]   2> 849692 T2393 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 849694 T2393
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 849695 T2393
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 849696 T2393 oass.OpenExchangeRatesOrgProvider.reload
>> Reloading exchange rates from open-exchange-rates.json
>>    [junit4]   2> 849698 T2393
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
>> IMPORTANT NOTE
>>    [junit4]   2> 849699 T2393
>> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
>> key, got STRING
>>    [junit4]   2> 849699 T2393 oasc.CoreContainer.create Creating SolrCore
>> 'collection1' using configuration from collection collection1
>>    [junit4]   2> 849699 T2393 oasc.SolrCore.initDirectoryFactory
>> org.apache.solr.core.MockDirectoryFactory
>>    [junit4]   2> 849699 T2393 oasc.SolrCore.<init> [collection1] Opening
>> new SolrCore at
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/,
>> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/
>>    [junit4]   2> 849700 T2393 oasc.JmxMonitoredMap.<init> JMX monitoring
>> is enabled. Adding Solr mbeans to JMX Server:
>> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>>    [junit4]   2> 849700 T2393 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2
>>    [junit4]   2> 849700 T2393 oasc.SolrCore.getNewIndexDir New index
>> directory detected: old=null
>> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index/
>>    [junit4]   2> 849701 T2393 oasc.SolrCore.initIndex WARN [collection1]
>> Solr index directory
>> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index'
>> doesn't exist. Creating new index...
>>    [junit4]   2> 849701 T2393 oasc.CachingDirectoryFactory.get return new
>> directory for
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index
>>    [junit4]   2> 849701 T2393 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.onCommit
>> SolrDeletionPolicy.onCommit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 849706 T2393 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "nodistrib"
>>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "dedupe"
>>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "stored_sig"
>>    [junit4]   2> 849708 T2393 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>>    [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init
>> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init
>> inserting DistributedUpdateProcessorFactory into
>> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>>    [junit4]   2> 849709 T2393 oasc.SolrCore.loadUpdateProcessorChains no
>> updateRequestProcessorChain defined as default, creating implicit default
>>    [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /update: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /config: org.apache.solr.handler.SolrConfigHandler
>>    [junit4]   2> 849712 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /schema: org.apache.solr.handler.SchemaHandler
>>    [junit4]   2> 849714 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /replication: org.apache.solr.handler.ReplicationHandler
>>    [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /get: org.apache.solr.handler.RealTimeGetHandler
>>    [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>>    [junit4]   2> 849716 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>>    [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>>    [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>>    [junit4]   2> 849718 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>>    [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/properties:
>> org.apache.solr.handler.admin.PropertiesRequestHandler
>>    [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>>    [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>>    [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created standard: solr.StandardRequestHandler
>>    [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/file: solr.admin.ShowFileRequestHandler
>>    [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig
>> created /admin/fileedit: solr.admin.EditFileRequestHandler
>>    [junit4]   2> 849730 T2393 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 849731 T2393 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 849733 T2393 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 849735 T2393 oashl.XMLLoader.init
>> xsltCacheLifetimeSeconds=60
>>    [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Hard AutoCommit:
>> disabled
>>    [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Soft AutoCommit:
>> disabled
>>    [junit4]   2> 849740 T2393 oasu.RandomMergePolicy.<init>
>> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
>> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
>> maxMergeSize=9223372036854775807,
>> maxMergeSizeForForcedMerge=9223372036854775807,
>> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
>> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>>    [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.onInit
>> SolrDeletionPolicy.onInit: commits: num=1
>>    [junit4]   2>
>> commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880
>> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f
>> ),segFN=segments_1,generation=1}
>>    [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.updateCommits
>> newest commit generation = 1
>>    [junit4]   2> 849742 T2393 oass.SolrIndexSearcher.<init> Opening
>> Searcher@49e1a7c7[collection1] main
>>    [junit4]   2> 849742 T2393 oascc.ZkStateReader.readConfigName Load
>> collection config from:/collections/collection1
>>    [junit4]   2> 849745 T2393 oascc.ZkStateReader.readConfigName
>> path=/collections/collection1 configName=conf1 specified config exists in
>> ZooKeeper
>>    [junit4]   2> 849745 T2393 oasr.ManagedResourceStorage.newStorageIO
>> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
>> /configs/conf1
>>    [junit4]   2> 849747 T2393
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
>> ZooKeeperStorageIO with znodeBase: /configs/conf1
>>    [junit4]   2> 849747 T2393 oasr.RestManager.init Initializing
>> RestManager with initArgs: {}
>>    [junit4]   2> 849747 T2393 oasr.ManagedResourceStorage.load Reading
>> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 849751 T2393
>> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38
>> bytes from znode /configs/conf1/_rest_managed.json
>>    [junit4]   2> 849751 T2393 oasr.ManagedResourceStorage.load Loaded
>> LinkedHashMap at path _rest_managed.json using
>> ZooKeeperStorageIO:path=/configs/conf1
>>    [junit4]   2> 849751 T2393 oasr.ManagedResource.reloadFromStorage
>> Loaded initArgs {} for /rest/managed
>>    [junit4]   2> 849752 T2393 oasr.RestManager.init Initializing 0
>> registered ManagedResources
>>    [junit4]   2> 849752 T2393 oash.ReplicationHandler.inform Commits will
>> be reserved for  10000
>>    [junit4]   2> 849753 T2393 oasc.CoreContainer.registerCore registering
>> core: collection1
>>    [junit4]   2> 849755 T2397 oasc.ZkController.register Register replica
>> - core:collection1 address:http://127.0.0.1:49865 collection:collection1
>> shard:shard1
>>    [junit4]   2> 849756 T2394 oasc.SolrCore.registerSearcher
>> [collection1] Registered new searcher Searcher@49e1a7c7[collection1]
>> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>>    [junit4]   2> 849756 T2316 oass.SolrDispatchFilter.init
>> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>>    [junit4]   2> 849758 T2316 oass.SolrDispatchFilter.init
>> SolrDispatchFilter.init() done
>>    [junit4]   2> 849760 T2397
>>
>> [...truncated too long message...]
>>
>> it4]   2> 888022 T2316 oasc.ZkController.unRegisterConfListener  a
>> listener was removed because of core close
>>    [junit4]   2> 888023 T2316 oasu.DirectUpdateHandler2.close closing
>> DirectUpdateHandler2{commits=0,autocommits=0,soft
>> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
>>    [junit4]   2> 888023 T2316 oasu.SolrCoreState.decrefSolrCoreState
>> Closing SolrCoreState
>>    [junit4]   2> 888023 T2485 oasc.Overseer$ClusterStateUpdater.run
>> processMessage: queueSize: 1, message = {
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node4",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49872",
>>    [junit4]   2>          "node_name":"127.0.0.1:49872_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"} current state version: 15
>>    [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter
>> SolrCoreState ref count has reached 0 - closing IndexWriter
>>    [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter
>> closing IndexWriter with IndexWriterCloser
>>    [junit4]   2> 888025 T2485 oasco.ReplicaMutator.updateState Update
>> state numShards=2 message={
>>    [junit4]   2>          "core":"collection1",
>>    [junit4]   2>          "core_node_name":"core_node4",
>>    [junit4]   2>          "roles":null,
>>    [junit4]   2>          "base_url":"http://127.0.0.1:49872",
>>    [junit4]   2>          "node_name":"127.0.0.1:49872_",
>>    [junit4]   2>          "numShards":"2",
>>    [junit4]   2>          "state":"down",
>>    [junit4]   2>          "shard":"shard1",
>>    [junit4]   2>          "collection":"collection1",
>>    [junit4]   2>          "operation":"state"}
>>    [junit4]   2> 888025 T2316 oasc.SolrCore.closeSearcher [collection1]
>> Closing main searcher on request.
>>    [junit4]   2> 888031 T2485 oasco.ZkStateWriter.writePendingUpdates
>> going to update_collection /collections/collection1/state.json version: 22
>>    [junit4]   2> 888039 T2316 oasc.CachingDirectoryFactory.close Closing
>> MockDirectoryFactory - 2 directories currently being tracked
>>    [junit4]   2> 888040 T2316
>> oasc.CachingDirectoryFactory.closeCacheValue looking to close
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index
>> [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index;done=false>>]
>>    [junit4]   2> 888041 T2316 oasc.CachingDirectoryFactory.close Closing
>> directory:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index
>>    [junit4]   2> 888042 T2434 oascc.ZkStateReader$7.process A cluster
>> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
>> path:/collections/collection1/state.json, has occurred - updating...
>>    [junit4]   2> 888042 T2316
>> oasc.CachingDirectoryFactory.closeCacheValue looking to close
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4
>> [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4;done=false>>]
>>    [junit4]   2> 888043 T2316 oasc.CachingDirectoryFactory.close Closing
>> directory:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4
>>    [junit4]   2> 888044 T2316 oasc.Overseer.close Overseer
>> (id=93006854147866637-127.0.0.1:49872_-n_0000000004) closing
>>    [junit4]   2> 888045 T2485 oasc.Overseer$ClusterStateUpdater.run
>> Overseer Loop exiting : 127.0.0.1:49872_
>>    [junit4]   2> 889547 T2434 oascc.ZkStateReader$7.process WARN
>> ZooKeeper watch triggered, but Solr cannot talk to ZK
>>    [junit4]   2> 889548 T2475 oascc.ZkStateReader$3.process WARN
>> ZooKeeper watch triggered, but Solr cannot talk to ZK
>>    [junit4]   2> 889565 T2316 oejsh.ContextHandler.doStop stopped
>> o.e.j.s.ServletContextHandler{/,null}
>>    [junit4]   2> 894556 T2316 oas.SolrTestCaseJ4.tearDown ###Ending
>> testDistribSearch
>>    [junit4]   2> 894558 T2316 oasc.ZkTestServer.send4LetterWord
>> connecting to 127.0.0.1:49854 49854
>>    [junit4]   2> 894571 T2317 oasc.ZkTestServer.send4LetterWord
>> connecting to 127.0.0.1:49854 49854
>>    [junit4]   2> 894790 T2317
>> oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations:
>>    [junit4]   2>        Maximum concurrent create/delete watches above
>> limit:
>>    [junit4]   2>
>>    [junit4]   2>                10      /solr/configs/conf1
>>    [junit4]   2>                6       /solr/aliases.json
>>    [junit4]   2>                6       /solr/clusterstate.json
>>    [junit4]   2>                4
>>  /solr/collections/collection1/state.json
>>    [junit4]   2>                2       /solr/configs/.system
>>    [junit4]   2>
>>    [junit4]   2>        Maximum concurrent children watches above limit:
>>    [junit4]   2>
>>    [junit4]   2>                6       /solr/live_nodes
>>    [junit4]   2>                5
>>  /solr/overseer/collection-queue-work
>>    [junit4]   2>                4       /solr/overseer/queue
>>    [junit4]   2>
>>    [junit4]   2> NOTE: reproduce with: ant test
>> -Dtestcase=TestDynamicLoading -Dtests.method=testDistribSearch
>> -Dtests.seed=CC8AD89B44D0A93D -Dtests.slow=true -Dtests.locale=es_GT
>> -Dtests.timezone=America/Kentucky/Louisville -Dtests.asserts=true
>> -Dtests.file.encoding=UTF-8
>>    [junit4] FAILURE 57.8s | TestDynamicLoading.testDistribSearch <<<
>>    [junit4]    > Throwable #1: java.lang.AssertionError: {
>>    [junit4]    >   "responseHeader":{
>>    [junit4]    >     "status":404,
>>    [junit4]    >     "QTime":14},
>>    [junit4]    >   "error":{
>>    [junit4]    >     "msg":"no such blob or version available: test/1",
>>    [junit4]    >     "code":404}}
>> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>>    [junit4]    >        at
>> __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
>>    [junit4]    >        at
>> org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
>>    [junit4]    >        at
>> org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
>>    [junit4]    >        at
>> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
>>    [junit4]    >        at java.lang.Thread.run(Thread.java:745)
>>    [junit4]   2> 894984 T2316 oas.SolrTestCaseJ4.deleteCore ###deleteCore
>>    [junit4]   2> NOTE: leaving temporary files on disk at:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001
>>    [junit4]   2> 57768 T2315 ccr.ThreadLeakControl.checkThreadLeaks
>> WARNING Will linger awaiting termination of 1 leaked thread(s).
>>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50):
>> {blobName=PostingsFormat(name=LuceneVarGapFixedInterval),
>> _version_=PostingsFormat(name=Memory doPackFST= false),
>> id=PostingsFormat(name=Direct), version=PostingsFormat(name=Memory
>> doPackFST= false),
>> timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{},
>> sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_GT,
>> timezone=America/Kentucky/Louisville
>>    [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20
>> (64-bit)/cpus=2,threads=1,free=139693720,total=288882688
>>    [junit4]   2> NOTE: All tests run in this JVM:
>> [TestSerializedLuceneMatchVersion, ReplicationFactorTest,
>> RAMDirectoryFactoryTest, TestLRUCache, OutputWriterTest, ZkStateWriterTest,
>> TestInitParams, TestExpandComponent, CoreAdminCreateDiscoverTest,
>> TestCloudSchemaless, MigrateRouteKeyTest, InfoHandlerTest,
>> DisMaxRequestHandlerTest, DistributedFacetPivotSmallTest,
>> HdfsLockFactoryTest, TestPHPSerializedResponseWriter, CursorPagingTest,
>> TestSolrXml, TestClassNameShortening, StressHdfsTest,
>> DistributedFacetPivotSmallAdvancedTest, TestIndexSearcher,
>> LoggingHandlerTest, TestCoreContainer, ExternalCollectionsTest,
>> TestSchemaNameResource, TestBinaryResponseWriter, TestRangeQuery,
>> QueryParsingTest, XmlUpdateRequestHandlerTest, TestAddFieldRealTimeGet,
>> AnalyticsQueryTest, DistribCursorPagingTest, TestRawResponseWriter,
>> ZkSolrClientTest, TestFastWriter, TestDynamicLoading]
>>    [junit4] Completed in 58.31s, 1 test, 1 failure <<< FAILURES!
>>
>> [...truncated 1307 lines...]
>> BUILD FAILED
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The
>> following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The
>> following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The
>> following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39:
>> The following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The
>> following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510:
>> The following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1349:
>> The following error occurred while executing this line:
>> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956:
>> There were test failures: 453 suites, 1850 tests, 1 failure, 37 ignored (21
>> assumptions)
>>
>> Total time: 166 minutes 36 seconds
>> Build step 'Invoke Ant' marked build as failure
>> [description-setter] Description set: Java: 64bit/jdk1.8.0
>> -XX:+UseCompressedOops -XX:+UseParallelGC (asserts: true)
>> Archiving artifacts
>> Recording test results
>> Email was triggered for: Failure - Any
>> Sending email for trigger: Failure - Any
>>
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
>> For additional commands, e-mail: dev-help@lucene.apache.org
>>
>
>
>
> --
> Regards,
> Shalin Shekhar Mangar.
>


-- 
-----------------------------------------------------
Noble Paul

Re: [JENKINS] Lucene-Solr-trunk-MacOSX (64bit/jdk1.8.0) - Build # 2008 - Still Failing!

Posted by Shalin Shekhar Mangar <sh...@gmail.com>.
This is probably related to SOLR-6787

On Sun, Dec 21, 2014 at 4:23 PM, Policeman Jenkins Server <
jenkins@thetaphi.de> wrote:

> Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-MacOSX/2008/
> Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC (asserts:
> true)
>
> 1 tests failed.
> FAILED:  org.apache.solr.core.TestDynamicLoading.testDistribSearch
>
> Error Message:
> {   "responseHeader":{     "status":404,     "QTime":14},   "error":{
>  "msg":"no such blob or version available: test/1",     "code":404}}
> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>
> Stack Trace:
> java.lang.AssertionError: {
>   "responseHeader":{
>     "status":404,
>     "QTime":14},
>   "error":{
>     "msg":"no such blob or version available: test/1",
>     "code":404}}
> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>         at
> __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
>         at org.junit.Assert.fail(Assert.java:93)
>         at org.junit.Assert.failNotEquals(Assert.java:647)
>         at org.junit.Assert.assertEquals(Assert.java:128)
>         at
> org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
>         at
> org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
>         at
> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:483)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
>         at
> com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
>         at
> org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
>         at
> org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
>         at
> com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
>         at
> org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
>         at
> org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
>         at
> org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
>         at
> com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
>         at
> com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
>         at java.lang.Thread.run(Thread.java:745)
>
>
>
>
> Build Log:
> [...truncated 8743 lines...]
>    [junit4] Suite: org.apache.solr.core.TestDynamicLoading
>    [junit4]   2> Creating dataDir:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/init-core-data-001
>    [junit4]   2> 837229 T2316 oas.SolrTestCaseJ4.buildSSLConfig Randomized
> ssl (false) and clientAuth (false)
>    [junit4]   2> 837230 T2316
> oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext
> system property: /
>    [junit4]   2> 837237 T2316 oas.SolrTestCaseJ4.setUp ###Starting
> testDistribSearch
>    [junit4]   2> 837239 T2316 oasc.ZkTestServer.run STARTING ZK TEST SERVER
>    [junit4]   1> client port:0.0.0.0/0.0.0.0:0
>    [junit4]   2> 837240 T2317 oasc.ZkTestServer$ZKServerMain.runFromConfig
> Starting server
>    [junit4]   2> 837341 T2316 oasc.ZkTestServer.run start zk server on
> port:49854
>    [junit4]   2> 837345 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 837348 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 837355 T2324 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@6e4d3d31
> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 837355 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 837355 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 837356 T2316 oascc.SolrZkClient.makePath makePath: /solr
>    [junit4]   2> 837365 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 837366 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 837370 T2327 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@36723d68
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 837370 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 837370 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 837371 T2316 oascc.SolrZkClient.makePath makePath:
> /collections/collection1
>    [junit4]   2> 837378 T2316 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/shards
>    [junit4]   2> 837385 T2316 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection
>    [junit4]   2> 837389 T2316 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection/shards
>    [junit4]   2> 837396 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml
> to /configs/conf1/solrconfig.xml
>    [junit4]   2> 837397 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/solrconfig.xml
>    [junit4]   2> 837404 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema.xml
> to /configs/conf1/schema.xml
>    [junit4]   2> 837405 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/schema.xml
>    [junit4]   2> 837412 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml
> to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>    [junit4]   2> 837413 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/solrconfig.snippet.randomindexconfig.xml
>    [junit4]   2> 837423 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt
> to /configs/conf1/stopwords.txt
>    [junit4]   2> 837423 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/stopwords.txt
>    [junit4]   2> 837429 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt
> to /configs/conf1/protwords.txt
>    [junit4]   2> 837430 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/protwords.txt
>    [junit4]   2> 837436 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml
> to /configs/conf1/currency.xml
>    [junit4]   2> 837437 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/currency.xml
>    [junit4]   2> 837443 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml
> to /configs/conf1/enumsConfig.xml
>    [junit4]   2> 837444 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/enumsConfig.xml
>    [junit4]   2> 837450 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json
> to /configs/conf1/open-exchange-rates.json
>    [junit4]   2> 837451 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/open-exchange-rates.json
>    [junit4]   2> 837457 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt
> to /configs/conf1/mapping-ISOLatin1Accent.txt
>    [junit4]   2> 837458 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/mapping-ISOLatin1Accent.txt
>    [junit4]   2> 837463 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt
> to /configs/conf1/old_synonyms.txt
>    [junit4]   2> 837463 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/old_synonyms.txt
>    [junit4]   2> 837469 T2316 oasc.AbstractZkTestCase.putConfig put
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt
> to /configs/conf1/synonyms.txt
>    [junit4]   2> 837469 T2316 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/synonyms.txt
>    [junit4]   2> 839165 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>    [junit4]   2> 839174 T2316 oejs.AbstractConnector.doStart Started
> SelectChannelConnector@127.0.0.1:49857
>    [junit4]   2> 839175 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>    [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 839176 T2316 oasc.SolrResourceLoader.locateSolrHome using
> system property solr.solr.home:
> ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002
>    [junit4]   2> 839177 T2316 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/'
>    [junit4]   2> 839217 T2316 oasc.ConfigSolr.fromFile Loading container
> configuration from
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/solr.xml
>    [junit4]   2> 839240 T2316 oasc.CoreContainer.<init> New CoreContainer
> 1028334353
>    [junit4]   2> 839240 T2316 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/]
>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 90000
>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to:
>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
>    [junit4]   2> 839241 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnections to: 10000
>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 839242 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 839243 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 839243 T2316 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=340000&connTimeout=45000&retry=false
>    [junit4]   2> 839244 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 839245 T2316 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 839245 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>    [junit4]   2> 839245 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:49854/solr
>    [junit4]   2> 839246 T2316 oasc.ZkController.checkChrootPath zkHost
> includes chroot
>    [junit4]   2> 839246 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 839248 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 839253 T2339 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@12e5b223
> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 839254 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 839255 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 839260 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 839263 T2342 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@6406c22
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 839264 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 839265 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/queue
>    [junit4]   2> 839273 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-queue-work
>    [junit4]   2> 839280 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-running
>    [junit4]   2> 839288 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-completed
>    [junit4]   2> 839294 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/collection-map-failure
>    [junit4]   2> 839302 T2316 oascc.SolrZkClient.makePath makePath:
> /live_nodes
>    [junit4]   2> 839304 T2316 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49857_
>    [junit4]   2> 839305 T2316 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:49857_
>    [junit4]   2> 839311 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer_elect
>    [junit4]   2> 839313 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer_elect/election
>    [junit4]   2> 839317 T2316 oasc.Overseer.close Overseer (id=null)
> closing
>    [junit4]   2> 839322 T2316
> oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader
> 127.0.0.1:49857_
>    [junit4]   2> 839323 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer_elect/leader
>    [junit4]   2> 839328 T2316 oasc.Overseer.start Overseer
> (id=93006854147866627-127.0.0.1:49857_-n_0000000000) starting
>    [junit4]   2> 839332 T2316 oascc.SolrZkClient.makePath makePath:
> /overseer/queue-work
>    [junit4]   2> 839351 T2316
> oasc.OverseerAutoReplicaFailoverThread.<init> Starting
> OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000
> autoReplicaFailoverWaitAfterExpiration=30000
> autoReplicaFailoverBadNodeExpiration=60000
>    [junit4]   2> 839353 T2344 oasc.OverseerCollectionProcessor.run Process
> current queue of collection creations
>    [junit4]   2> 839355 T2316 oascc.SolrZkClient.makePath makePath:
> /clusterstate.json
>    [junit4]   2> 839361 T2316 oascc.SolrZkClient.makePath makePath:
> /aliases.json
>    [junit4]   2> 839364 T2316
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 839375 T2343 oasc.Overseer$ClusterStateUpdater.run
> Starting to work on the main queue
>    [junit4]   2> 839383 T2346 oasc.ZkController.publish publishing
> core=collection1 state=down collection=control_collection
>    [junit4]   2> 839383 T2346 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
>    [junit4]   2> 839385 T2346 oasc.ZkController.waitForCoreNodeName look
> for our core node name
>    [junit4]   2> 839385 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 839392 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 0, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>    [junit4]   2>          "numShards":"1",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"control_collection",
>    [junit4]   2>          "operation":"state"} current state version: 0
>    [junit4]   2> 839393 T2343 oasco.ReplicaMutator.updateState Update
> state numShards=1 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>    [junit4]   2>          "numShards":"1",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"control_collection",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 839393 T2343 oasco.ClusterStateMutator.createCollection
> building a new cName: control_collection
>    [junit4]   2> 839394 T2343 oasco.ReplicaMutator.updateState Assigning
> new node to shard shard=shard1
>    [junit4]   2> 839395 T2342 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 840387 T2346 oasc.ZkController.waitForShardId waiting to
> find shard id in clusterstate for collection1
>    [junit4]   2> 840387 T2346 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:control_collection
>    [junit4]   2> 840389 T2346 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
>    [junit4]   2> 840389 T2346 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/control_collection
>    [junit4]   2> 840395 T2346 oascc.ZkStateReader.readConfigName
> path=/collections/control_collection configName=conf1 specified config
> exists in ZooKeeper
>    [junit4]   2> 840395 T2346 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/'
>    [junit4]   2> 840397 T2346 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/.svn/'
> to classloader
>    [junit4]   2> 840398 T2346 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 840399 T2346 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/lib/README'
> to classloader
>    [junit4]   2> 840444 T2346 oasc.ZkController.watchZKConfDir watch zkdir
> /configs/conf1
>    [junit4]   2> 840450 T2346 oasc.Config.<init> loaded config
> solrconfig.xml with version 0
>    [junit4]   2> 840469 T2346 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: 6.0.0
>    [junit4]   2> 840481 T2346 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
>    [junit4]   2> 840486 T2346 oass.IndexSchema.readSchema Reading Solr
> Schema from /configs/conf1/schema.xml
>    [junit4]   2> 840494 T2346 oass.IndexSchema.readSchema [collection1]
> Schema name=test
>    [junit4]   2> 840630 T2346 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>    [junit4]   2> 840644 T2346 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 840647 T2346 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 840690 T2346 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 840694 T2346 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 840699 T2346 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 840702 T2346
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 840703 T2346
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 840703 T2346 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 840706 T2346
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 840706 T2346
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 840706 T2346 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using configuration from collection control_collection
>    [junit4]   2> 840707 T2346 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 840707 T2346 oasc.SolrCore.<init> [collection1] Opening
> new SolrCore at
> ../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-002/collection1/,
> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/
>    [junit4]   2> 840707 T2346 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>    [junit4]   2> 840708 T2346 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data
>    [junit4]   2> 840708 T2346 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index/
>    [junit4]   2> 840709 T2346 oasc.SolrCore.initIndex WARN [collection1]
> Solr index directory
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index'
> doesn't exist. Creating new index...
>    [junit4]   2> 840709 T2346 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/control/data/index
>    [junit4]   2> 840710 T2346 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 840710 T2346 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 840711 T2346 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
>    [junit4]   2> 840717 T2346 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 840718 T2346 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>    [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 840720 T2346 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 840720 T2346 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /update: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 840721 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 840722 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 840723 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /config: org.apache.solr.handler.SolrConfigHandler
>    [junit4]   2> 840724 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /schema: org.apache.solr.handler.SchemaHandler
>    [junit4]   2> 840725 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: org.apache.solr.handler.ReplicationHandler
>    [junit4]   2> 840726 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /get: org.apache.solr.handler.RealTimeGetHandler
>    [junit4]   2> 840727 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>    [junit4]   2> 840728 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>    [junit4]   2> 840729 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>    [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>    [junit4]   2> 840730 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>    [junit4]   2> 840731 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/properties:
> org.apache.solr.handler.admin.PropertiesRequestHandler
>    [junit4]   2> 840732 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>    [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>    [junit4]   2> 840733 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
>    [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/file: solr.admin.ShowFileRequestHandler
>    [junit4]   2> 840734 T2346 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/fileedit: solr.admin.EditFileRequestHandler
>    [junit4]   2> 840747 T2346 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 840749 T2346 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 840750 T2346 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 840752 T2346 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 840757 T2346 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
>    [junit4]   2> 840758 T2346 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
>    [junit4]   2> 840758 T2346 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.onInit
> SolrDeletionPolicy.onInit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@4625a372
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3a8a04e8
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 840759 T2346 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 840760 T2346 oass.SolrIndexSearcher.<init> Opening
> Searcher@4de3bbc[collection1] main
>    [junit4]   2> 840760 T2346 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/control_collection
>    [junit4]   2> 840763 T2346 oascc.ZkStateReader.readConfigName
> path=/collections/control_collection configName=conf1 specified config
> exists in ZooKeeper
>    [junit4]   2> 840763 T2346 oasr.ManagedResourceStorage.newStorageIO
> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
> /configs/conf1
>    [junit4]   2> 840764 T2346
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
> ZooKeeperStorageIO with znodeBase: /configs/conf1
>    [junit4]   2> 840765 T2346 oasr.RestManager.init Initializing
> RestManager with initArgs: {}
>    [junit4]   2> 840765 T2346 oasr.ManagedResourceStorage.load Reading
> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 840768 T2346
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data
> found for znode /configs/conf1/_rest_managed.json
>    [junit4]   2> 840768 T2346 oasr.ManagedResourceStorage.load Loaded null
> at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 840770 T2346 oascc.SolrZkClient.makePath makePath:
> /configs/conf1/_rest_managed.json
>    [junit4]   2> 840776 T2346
> oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to
> new znode /configs/conf1/_rest_managed.json
>    [junit4]   2> 840776 T2346
> oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path
> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 840776 T2346 oasr.RestManager.init Initializing 0
> registered ManagedResources
>    [junit4]   2> 840776 T2346 oash.ReplicationHandler.inform Commits will
> be reserved for  10000
>    [junit4]   2> 840778 T2347 oasc.SolrCore.registerSearcher [collection1]
> Registered new searcher Searcher@4de3bbc[collection1]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 840779 T2346 oasc.CoreContainer.registerCore registering
> core: collection1
>    [junit4]   2> 840782 T2350 oasc.ZkController.register Register replica
> - core:collection1 address:http://127.0.0.1:49857
> collection:control_collection shard:shard1
>    [junit4]   2> 840782 T2316 oass.SolrDispatchFilter.init
> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>    [junit4]   2> 840783 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
>    [junit4]   2> 840783 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 840785 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 840793 T2353 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@7d66f1d9
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 840793 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 840794 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 840796 T2316
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 840798 T2350 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection/leader_elect/shard1/election
>    [junit4]   2> 840805 T2316 oasc.ChaosMonkey.monkeyLog monkey: init -
> expire sessions:false cause connection loss:false
>    [junit4]   2> 840805 T2316
> oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with
> stateFormat=2
>    [junit4]   2> 840807 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 840811 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 840816 T2356 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@4d205ac9
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 840817 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 840817 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 840824 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 840845 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "operation":"create",
>    [junit4]   2>          "name":"collection1",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "stateFormat":2} current state version: 1
>    [junit4]   2> 840845 T2343 oasco.ClusterStateMutator.createCollection
> building a new cName: collection1
>    [junit4]   2> 840860 T2350
> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process
> for shard shard1
>    [junit4]   2> 840879 T2350
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
> found to continue.
>    [junit4]   2> 840880 T2350
> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader -
> try and sync
>    [junit4]   2> ASYNC  NEW_CORE C1382 name=collection1
> org.apache.solr.core.SolrCore@755e68c7 url=
> http://127.0.0.1:49857/collection1 node=127.0.0.1:49857_
> C1382_STATE=coll:control_collection core:collection1
> props:{core=collection1, base_url=http://127.0.0.1:49857,
> node_name=127.0.0.1:49857_, state=down}
>    [junit4]   2> 840880 T2350 C1382 P49857 oasc.SyncStrategy.sync Sync
> replicas to http://127.0.0.1:49857/collection1/
>    [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncReplicas
> Sync Success - now sync replicas to me
>    [junit4]   2> 840881 T2350 C1382 P49857 oasc.SyncStrategy.syncToMe
> http://127.0.0.1:49857/collection1/ has no replicas
>    [junit4]   2> 840881 T2350
> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
> http://127.0.0.1:49857/collection1/ shard1
>    [junit4]   2> 840881 T2350 oascc.SolrZkClient.makePath makePath:
> /collections/control_collection/leaders/shard1
>    [junit4]   2> 840884 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "operation":"leader",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"control_collection"} current state
> version: 1
>    [junit4]   2> 840890 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to create_collection /collections/collection1/state.json
>    [junit4]   2> 840897 T2353 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 840897 T2342 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 840915 T2357 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 840933 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "operation":"leader",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"control_collection",
>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "state":"active"} current state version: 2
>    [junit4]   2> 840947 T2357 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 841053 T2353 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 841127 T2350 oasc.ZkController.register We are
> http://127.0.0.1:49857/collection1/ and leader is
> http://127.0.0.1:49857/collection1/
>    [junit4]   2> 841127 T2350 oasc.ZkController.register No LogReplay
> needed for core=collection1 baseURL=http://127.0.0.1:49857
>    [junit4]   2> 841127 T2350 oasc.ZkController.checkRecovery I am the
> leader, no recovery necessary
>    [junit4]   2> 841130 T2350 oasc.ZkController.publish publishing
> core=collection1 state=active collection=control_collection
>    [junit4]   2> 841132 T2350 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
>    [junit4]   2> 841139 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 841156 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"active",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"control_collection",
>    [junit4]   2>          "operation":"state"} current state version: 3
>    [junit4]   2> 841159 T2343 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49857",
>    [junit4]   2>          "node_name":"127.0.0.1:49857_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"active",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"control_collection",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 841276 T2353 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 841276 T2342 oascc.ZkStateReader$2.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
>    [junit4]   2> 842764 T2316
> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
>    [junit4]   2> 842765 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>    [junit4]   2> 842771 T2316 oejs.AbstractConnector.doStart Started
> SelectChannelConnector@127.0.0.1:49862
>    [junit4]   2> 842772 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>    [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 842772 T2316 oasc.SolrResourceLoader.locateSolrHome using
> system property solr.solr.home:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003
>    [junit4]   2> 842773 T2316 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/'
>    [junit4]   2> 842810 T2316 oasc.ConfigSolr.fromFile Loading container
> configuration from
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/solr.xml
>    [junit4]   2> 842829 T2316 oasc.CoreContainer.<init> New CoreContainer
> 335265571
>    [junit4]   2> 842829 T2316 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/]
>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 90000
>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to:
>    [junit4]   2> 842830 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
>    [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 842831 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnections to: 10000
>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 842832 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 842833 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 842834 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 842835 T2316 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=340000&connTimeout=45000&retry=false
>    [junit4]   2> 842836 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 842836 T2316 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 842837 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>    [junit4]   2> 842837 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:49854/solr
>    [junit4]   2> 842837 T2316 oasc.ZkController.checkChrootPath zkHost
> includes chroot
>    [junit4]   2> 842838 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 842839 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 842844 T2369 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@7f590f35
> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 842845 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 842846 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 842852 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 842859 T2372 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@634dd196
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 842859 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 842884 T2316
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 843905 T2316 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49862_
>    [junit4]   2> 843907 T2316 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:49862_
>    [junit4]   2> 843919 T2316 oasc.Overseer.close Overseer (id=null)
> closing
>    [junit4]   2> 843934 T2373 oasc.ZkController.publish publishing
> core=collection1 state=down collection=collection1
>    [junit4]   2> 843934 T2373 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
>    [junit4]   2> 843941 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 843941 T2373 oasc.ZkController.preRegister Registering
> watch for external collection collection1
>    [junit4]   2> 843944 T2373 oascc.ZkStateReader.addZkWatch addZkWatch
> collection1
>    [junit4]   2> 843943 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"} current state version: 4
>    [junit4]   2> 843945 T2373 oascc.ZkStateReader.addZkWatch Updating
> collection state at /collections/collection1/state.json from ZooKeeper...
>    [junit4]   2> 843946 T2343 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Collection
> already exists with numShards=2
>    [junit4]   2> 843947 T2343 oasco.ReplicaMutator.updateState Assigning
> new node to shard shard=shard2
>    [junit4]   2> 843950 T2373 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 0
>    [junit4]   2> 843950 T2373 oasc.ZkController.waitForCoreNodeName look
> for our core node name
>    [junit4]   2> 843952 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 0
>    [junit4]   2> 843953 T2372 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 843955 T2372 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 1
>    [junit4]   2> 844953 T2373 oasc.ZkController.waitForShardId waiting to
> find shard id in clusterstate for collection1
>    [junit4]   2> 844954 T2373 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:collection1
>    [junit4]   2> 844957 T2373 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
>    [junit4]   2> 844957 T2373 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/collection1
>    [junit4]   2> 844964 T2373 oascc.ZkStateReader.readConfigName
> path=/collections/collection1 configName=conf1 specified config exists in
> ZooKeeper
>    [junit4]   2> 844965 T2373 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/'
>    [junit4]   2> 844967 T2373 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/.svn/'
> to classloader
>    [junit4]   2> 844968 T2373 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 844969 T2373 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/lib/README'
> to classloader
>    [junit4]   2> 845009 T2373 oasc.ZkController.watchZKConfDir watch zkdir
> /configs/conf1
>    [junit4]   2> 845015 T2373 oasc.Config.<init> loaded config
> solrconfig.xml with version 0
>    [junit4]   2> 845033 T2373 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: 6.0.0
>    [junit4]   2> 845046 T2373 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
>    [junit4]   2> 845049 T2373 oass.IndexSchema.readSchema Reading Solr
> Schema from /configs/conf1/schema.xml
>    [junit4]   2> 845056 T2373 oass.IndexSchema.readSchema [collection1]
> Schema name=test
>    [junit4]   2> 845191 T2373 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>    [junit4]   2> 845206 T2373 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 845207 T2373 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 845244 T2373 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 845249 T2373 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 845253 T2373 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 845256 T2373
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 845258 T2373
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 845258 T2373 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 845262 T2373
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 845262 T2373
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 845263 T2373 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using configuration from collection collection1
>    [junit4]   2> 845263 T2373 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 845263 T2373 oasc.SolrCore.<init> [collection1] Opening
> new SolrCore at
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-003/collection1/,
> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/
>    [junit4]   2> 845264 T2373 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>    [junit4]   2> 845264 T2373 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1
>    [junit4]   2> 845265 T2373 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index/
>    [junit4]   2> 845265 T2373 oasc.SolrCore.initIndex WARN [collection1]
> Solr index directory
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index'
> doesn't exist. Creating new index...
>    [junit4]   2> 845265 T2373 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty1/index
>    [junit4]   2> 845266 T2373 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 845267 T2373 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
>    [junit4]   2> 845273 T2373 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 845274 T2373 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>    [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 845275 T2373 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 845275 T2373 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /update: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 845276 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 845277 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /config: org.apache.solr.handler.SolrConfigHandler
>    [junit4]   2> 845278 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /schema: org.apache.solr.handler.SchemaHandler
>    [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: org.apache.solr.handler.ReplicationHandler
>    [junit4]   2> 845280 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /get: org.apache.solr.handler.RealTimeGetHandler
>    [junit4]   2> 845281 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>    [junit4]   2> 845285 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>    [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>    [junit4]   2> 845286 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/properties:
> org.apache.solr.handler.admin.PropertiesRequestHandler
>    [junit4]   2> 845287 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>    [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>    [junit4]   2> 845288 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
>    [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/file: solr.admin.ShowFileRequestHandler
>    [junit4]   2> 845289 T2373 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/fileedit: solr.admin.EditFileRequestHandler
>    [junit4]   2> 845296 T2373 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 845297 T2373 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 845298 T2373 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 845299 T2373 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 845301 T2373 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
>    [junit4]   2> 845302 T2373 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
>    [junit4]   2> 845303 T2373 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.onInit
> SolrDeletionPolicy.onInit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@2fb05928
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@19766ec3
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 845304 T2373 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 845304 T2373 oass.SolrIndexSearcher.<init> Opening
> Searcher@1466a306[collection1] main
>    [junit4]   2> 845305 T2373 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/collection1
>    [junit4]   2> 845307 T2373 oascc.ZkStateReader.readConfigName
> path=/collections/collection1 configName=conf1 specified config exists in
> ZooKeeper
>    [junit4]   2> 845308 T2373 oasr.ManagedResourceStorage.newStorageIO
> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
> /configs/conf1
>    [junit4]   2> 845309 T2373
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
> ZooKeeperStorageIO with znodeBase: /configs/conf1
>    [junit4]   2> 845309 T2373 oasr.RestManager.init Initializing
> RestManager with initArgs: {}
>    [junit4]   2> 845309 T2373 oasr.ManagedResourceStorage.load Reading
> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 845313 T2373
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38
> bytes from znode /configs/conf1/_rest_managed.json
>    [junit4]   2> 845313 T2373 oasr.ManagedResourceStorage.load Loaded
> LinkedHashMap at path _rest_managed.json using
> ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 845313 T2373 oasr.ManagedResource.reloadFromStorage
> Loaded initArgs {} for /rest/managed
>    [junit4]   2> 845314 T2373 oasr.RestManager.init Initializing 0
> registered ManagedResources
>    [junit4]   2> 845314 T2373 oash.ReplicationHandler.inform Commits will
> be reserved for  10000
>    [junit4]   2> 845315 T2374 oasc.SolrCore.registerSearcher [collection1]
> Registered new searcher Searcher@1466a306[collection1]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 845315 T2373 oasc.CoreContainer.registerCore registering
> core: collection1
>    [junit4]   2> 845317 T2377 oasc.ZkController.register Register replica
> - core:collection1 address:http://127.0.0.1:49862 collection:collection1
> shard:shard2
>    [junit4]   2> 845318 T2316 oass.SolrDispatchFilter.init
> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>    [junit4]   2> 845319 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
>    [junit4]   2> 845320 T2377 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/leader_elect/shard2/election
>    [junit4]   2> 845338 T2377
> oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process
> for shard shard2
>    [junit4]   2> 845345 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 845347 T2377
> oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas
> found to continue.
>    [junit4]   2> 845347 T2377
> oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader -
> try and sync
>    [junit4]   2> ASYNC  NEW_CORE C1383 name=collection1
> org.apache.solr.core.SolrCore@2dc8d5fa url=
> http://127.0.0.1:49862/collection1 node=127.0.0.1:49862_
> C1383_STATE=coll:collection1 core:collection1 props:{core=collection1,
> base_url=http://127.0.0.1:49862, node_name=127.0.0.1:49862_, state=down}
>    [junit4]   2> 845347 T2377 C1383 P49862 oasc.SyncStrategy.sync Sync
> replicas to http://127.0.0.1:49862/collection1/
>    [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncReplicas
> Sync Success - now sync replicas to me
>    [junit4]   2> 845348 T2377 C1383 P49862 oasc.SyncStrategy.syncToMe
> http://127.0.0.1:49862/collection1/ has no replicas
>    [junit4]   2> 845348 T2377
> oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader:
> http://127.0.0.1:49862/collection1/ shard2
>    [junit4]   2> 845348 T2377 oascc.SolrZkClient.makePath makePath:
> /collections/collection1/leaders/shard2
>    [junit4]   2> 845349 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "operation":"leader",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"collection1"} current state
> version: 4
>    [junit4]   2> 845357 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 1
>    [junit4]   2> 845361 T2372 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 845364 T2372 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 2
>    [junit4]   2> 845390 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 845393 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "operation":"leader",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "state":"active"} current state version: 4
>    [junit4]   2> 845396 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 2
>    [junit4]   2> 845397 T2372 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 845401 T2372 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 3
>    [junit4]   2> 845446 T2377 oasc.ZkController.register We are
> http://127.0.0.1:49862/collection1/ and leader is
> http://127.0.0.1:49862/collection1/
>    [junit4]   2> 845446 T2377 oasc.ZkController.register No LogReplay
> needed for core=collection1 baseURL=http://127.0.0.1:49862
>    [junit4]   2> 845447 T2377 oasc.ZkController.checkRecovery I am the
> leader, no recovery necessary
>    [junit4]   2> 845447 T2377 oasc.ZkController.publish publishing
> core=collection1 state=active collection=collection1
>    [junit4]   2> 845447 T2377 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
>    [junit4]   2> 845450 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 845455 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"active",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"} current state version: 4
>    [junit4]   2> 845459 T2343 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49862",
>    [junit4]   2>          "node_name":"127.0.0.1:49862_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"active",
>    [junit4]   2>          "shard":"shard2",
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 845466 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 3
>    [junit4]   2> 845475 T2372 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 845481 T2377 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 4
>    [junit4]   2> 845483 T2372 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 4
>    [junit4]   2> 847246 T2316
> oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
>    [junit4]   2> 847247 T2316 oejs.Server.doStart jetty-8.1.10.v20130312
>    [junit4]   2> 847252 T2316 oejs.AbstractConnector.doStart Started
> SelectChannelConnector@127.0.0.1:49865
>    [junit4]   2> 847253 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4554617c
>    [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome JNDI
> not configured for solr (NoInitialContextEx)
>    [junit4]   2> 847254 T2316 oasc.SolrResourceLoader.locateSolrHome using
> system property solr.solr.home:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004
>    [junit4]   2> 847255 T2316 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/'
>    [junit4]   2> 847309 T2316 oasc.ConfigSolr.fromFile Loading container
> configuration from
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/solr.xml
>    [junit4]   2> 847325 T2316 oasc.CoreContainer.<init> New CoreContainer
> 1078127689
>    [junit4]   2> 847325 T2316 oasc.CoreContainer.load Loading cores into
> CoreContainer
> [instanceDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/]
>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting socketTimeout to: 90000
>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting urlScheme to:
>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting connTimeout to: 15000
>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnectionsPerHost to: 20
>    [junit4]   2> 847326 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxConnections to: 10000
>    [junit4]   2> 847327 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting corePoolSize to: 0
>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maximumPoolSize to: 2147483647
>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting maxThreadIdleTime to: 5
>    [junit4]   2> 847328 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting sizeOfQueue to: -1
>    [junit4]   2> 847329 T2316 oashc.HttpShardHandlerFactory.getParameter
> Setting fairnessPolicy to: false
>    [junit4]   2> 847329 T2316 oasu.UpdateShardHandler.<init> Creating
> UpdateShardHandler HTTP client with params:
> socketTimeout=340000&connTimeout=45000&retry=false
>    [junit4]   2> 847330 T2316 oasl.LogWatcher.createWatcher SLF4J impl is
> org.slf4j.impl.Log4jLoggerFactory
>    [junit4]   2> 847330 T2316 oasl.LogWatcher.newRegisteredLogWatcher
> Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
>    [junit4]   2> 847330 T2316 oasc.CoreContainer.load Host Name: 127.0.0.1
>    [junit4]   2> 847330 T2316 oasc.ZkContainer.initZooKeeper Zookeeper
> client=127.0.0.1:49854/solr
>    [junit4]   2> 847330 T2316 oasc.ZkController.checkChrootPath zkHost
> includes chroot
>    [junit4]   2> 847331 T2316
> oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default
> ZkCredentialsProvider
>    [junit4]   2> 847335 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 847336 T2389 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@ece84e9
> name:ZooKeeperConnection Watcher:127.0.0.1:49854 got event WatchedEvent
> state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 847338 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 847338 T2316 oascc.SolrZkClient.createZkACLProvider Using
> default ZkACLProvider
>    [junit4]   2> 847344 T2316 oascc.ConnectionManager.waitForConnected
> Waiting for client to connect to ZooKeeper
>    [junit4]   2> 847347 T2392 oascc.ConnectionManager.process Watcher
> org.apache.solr.common.cloud.ConnectionManager@634647ce
> name:ZooKeeperConnection Watcher:127.0.0.1:49854/solr got event
> WatchedEvent state:SyncConnected type:None path:null path:null type:None
>    [junit4]   2> 847347 T2316 oascc.ConnectionManager.waitForConnected
> Client is connected to ZooKeeper
>    [junit4]   2> 847362 T2316
> oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster
> state from ZooKeeper...
>    [junit4]   2> 848381 T2316 oasc.ZkController.createEphemeralLiveNode
> Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49865_
>    [junit4]   2> 848388 T2316 oascc.SolrZkClient.makePath makePath:
> /live_nodes/127.0.0.1:49865_
>    [junit4]   2> 848403 T2316 oasc.Overseer.close Overseer (id=null)
> closing
>    [junit4]   2> 848422 T2393 oasc.ZkController.publish publishing
> core=collection1 state=down collection=collection1
>    [junit4]   2> 848422 T2393 oasc.ZkController.publish numShards not
> found on descriptor - reading it from system property
>    [junit4]   2> 848428 T2342 oasc.DistributedQueue$LatchWatcher.process
> NodeChildrenChanged fired on path /overseer/queue state SyncConnected
>    [junit4]   2> 848429 T2393 oasc.ZkController.preRegister Registering
> watch for external collection collection1
>    [junit4]   2> 848429 T2393 oascc.ZkStateReader.addZkWatch addZkWatch
> collection1
>    [junit4]   2> 848431 T2393 oascc.ZkStateReader.addZkWatch Updating
> collection state at /collections/collection1/state.json from ZooKeeper...
>    [junit4]   2> 848432 T2343 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49865",
>    [junit4]   2>          "node_name":"127.0.0.1:49865_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"} current state version: 4
>    [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49865",
>    [junit4]   2>          "node_name":"127.0.0.1:49865_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":null,
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 848434 T2343 oasco.ReplicaMutator.updateState Collection
> already exists with numShards=2
>    [junit4]   2> 848435 T2393 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 4
>    [junit4]   2> 848435 T2343 oasco.ReplicaMutator.updateState Assigning
> new node to shard shard=shard1
>    [junit4]   2> 848435 T2393 oasc.ZkController.waitForCoreNodeName look
> for our core node name
>    [junit4]   2> 848440 T2343 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 4
>    [junit4]   2> 848442 T2392 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 848442 T2372 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 848444 T2392 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 5
>    [junit4]   2> 848444 T2372 oascc.ZkStateReader.updateWatchedCollection
> Updating data for collection1 to ver 5
>    [junit4]   2> 849438 T2393 oasc.ZkController.waitForShardId waiting to
> find shard id in clusterstate for collection1
>    [junit4]   2> 849439 T2393 oasc.ZkController.createCollectionZkNode
> Check for collection zkNode:collection1
>    [junit4]   2> 849442 T2393 oasc.ZkController.createCollectionZkNode
> Collection zkNode exists
>    [junit4]   2> 849442 T2393 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/collection1
>    [junit4]   2> 849445 T2393 oascc.ZkStateReader.readConfigName
> path=/collections/collection1 configName=conf1 specified config exists in
> ZooKeeper
>    [junit4]   2> 849446 T2393 oasc.SolrResourceLoader.<init> new
> SolrResourceLoader for directory:
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/'
>    [junit4]   2> 849448 T2393 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/.svn/'
> to classloader
>    [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/classes/'
> to classloader
>    [junit4]   2> 849449 T2393 oasc.SolrResourceLoader.replaceClassLoader
> Adding
> 'file:/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/lib/README'
> to classloader
>    [junit4]   2> 849480 T2393 oasc.ZkController.watchZKConfDir watch zkdir
> /configs/conf1
>    [junit4]   2> 849487 T2393 oasc.Config.<init> loaded config
> solrconfig.xml with version 0
>    [junit4]   2> 849502 T2393 oasc.SolrConfig.<init> Using Lucene
> MatchVersion: 6.0.0
>    [junit4]   2> 849518 T2393 oasc.SolrConfig.<init> Loaded SolrConfig:
> solrconfig.xml
>    [junit4]   2> 849524 T2393 oass.IndexSchema.readSchema Reading Solr
> Schema from /configs/conf1/schema.xml
>    [junit4]   2> 849534 T2393 oass.IndexSchema.readSchema [collection1]
> Schema name=test
>    [junit4]   2> 849647 T2393 oass.OpenExchangeRatesOrgProvider.init
> Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
>    [junit4]   2> 849655 T2393 oass.IndexSchema.readSchema default search
> field in schema is text
>    [junit4]   2> 849656 T2393 oass.IndexSchema.readSchema unique key
> field: id
>    [junit4]   2> 849681 T2393 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 849687 T2393 oass.FileExchangeRateProvider.reload
> Reloading exchange rates from file currency.xml
>    [junit4]   2> 849692 T2393 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 849694 T2393
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 849695 T2393
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 849696 T2393 oass.OpenExchangeRatesOrgProvider.reload
> Reloading exchange rates from open-exchange-rates.json
>    [junit4]   2> 849698 T2393
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key
> IMPORTANT NOTE
>    [junit4]   2> 849699 T2393
> oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected
> key, got STRING
>    [junit4]   2> 849699 T2393 oasc.CoreContainer.create Creating SolrCore
> 'collection1' using configuration from collection collection1
>    [junit4]   2> 849699 T2393 oasc.SolrCore.initDirectoryFactory
> org.apache.solr.core.MockDirectoryFactory
>    [junit4]   2> 849699 T2393 oasc.SolrCore.<init> [collection1] Opening
> new SolrCore at
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-004/collection1/,
> dataDir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/
>    [junit4]   2> 849700 T2393 oasc.JmxMonitoredMap.<init> JMX monitoring
> is enabled. Adding Solr mbeans to JMX Server:
> com.sun.jmx.mbeanserver.JmxMBeanServer@2fb2b6a6
>    [junit4]   2> 849700 T2393 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2
>    [junit4]   2> 849700 T2393 oasc.SolrCore.getNewIndexDir New index
> directory detected: old=null
> new=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index/
>    [junit4]   2> 849701 T2393 oasc.SolrCore.initIndex WARN [collection1]
> Solr index directory
> '/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index'
> doesn't exist. Creating new index...
>    [junit4]   2> 849701 T2393 oasc.CachingDirectoryFactory.get return new
> directory for
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty2/index
>    [junit4]   2> 849701 T2393 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=24,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=false, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.onCommit
> SolrDeletionPolicy.onCommit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 849702 T2393 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 849706 T2393 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "nodistrib"
>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "dedupe"
>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "dedupe"
>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 849707 T2393 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "stored_sig"
>    [junit4]   2> 849708 T2393 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
>    [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init
> creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 849709 T2393 oasup.UpdateRequestProcessorChain.init
> inserting DistributedUpdateProcessorFactory into
> updateRequestProcessorChain "distrib-dup-test-chain-implicit"
>    [junit4]   2> 849709 T2393 oasc.SolrCore.loadUpdateProcessorChains no
> updateRequestProcessorChain defined as default, creating implicit default
>    [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /update: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 849710 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /update/csv: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
>    [junit4]   2> 849711 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /config: org.apache.solr.handler.SolrConfigHandler
>    [junit4]   2> 849712 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /schema: org.apache.solr.handler.SchemaHandler
>    [junit4]   2> 849714 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /replication: org.apache.solr.handler.ReplicationHandler
>    [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /get: org.apache.solr.handler.RealTimeGetHandler
>    [junit4]   2> 849715 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
>    [junit4]   2> 849716 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
>    [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
>    [junit4]   2> 849717 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
>    [junit4]   2> 849718 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
>    [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/properties:
> org.apache.solr.handler.admin.PropertiesRequestHandler
>    [junit4]   2> 849719 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
>    [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/ping: org.apache.solr.handler.PingRequestHandler
>    [junit4]   2> 849720 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created standard: solr.StandardRequestHandler
>    [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/file: solr.admin.ShowFileRequestHandler
>    [junit4]   2> 849721 T2393 oasc.RequestHandlers.initHandlersFromConfig
> created /admin/fileedit: solr.admin.EditFileRequestHandler
>    [junit4]   2> 849730 T2393 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 849731 T2393 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 849733 T2393 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 849735 T2393 oashl.XMLLoader.init
> xsltCacheLifetimeSeconds=60
>    [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Hard AutoCommit:
> disabled
>    [junit4]   2> 849738 T2393 oasu.CommitTracker.<init> Soft AutoCommit:
> disabled
>    [junit4]   2> 849740 T2393 oasu.RandomMergePolicy.<init>
> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy:
> [LogDocMergePolicy: minMergeSize=1000, mergeFactor=12,
> maxMergeSize=9223372036854775807,
> maxMergeSizeForForcedMerge=9223372036854775807,
> calibrateSizeByDeletes=true, maxMergeDocs=2147483647,
> maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
>    [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.onInit
> SolrDeletionPolicy.onInit: commits: num=1
>    [junit4]   2>
> commit{dir=MockDirectoryWrapper(RAMDirectory@3df67880
> lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@7941453f
> ),segFN=segments_1,generation=1}
>    [junit4]   2> 849741 T2393 oasc.SolrDeletionPolicy.updateCommits newest
> commit generation = 1
>    [junit4]   2> 849742 T2393 oass.SolrIndexSearcher.<init> Opening
> Searcher@49e1a7c7[collection1] main
>    [junit4]   2> 849742 T2393 oascc.ZkStateReader.readConfigName Load
> collection config from:/collections/collection1
>    [junit4]   2> 849745 T2393 oascc.ZkStateReader.readConfigName
> path=/collections/collection1 configName=conf1 specified config exists in
> ZooKeeper
>    [junit4]   2> 849745 T2393 oasr.ManagedResourceStorage.newStorageIO
> Setting up ZooKeeper-based storage for the RestManager with znodeBase:
> /configs/conf1
>    [junit4]   2> 849747 T2393
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured
> ZooKeeperStorageIO with znodeBase: /configs/conf1
>    [junit4]   2> 849747 T2393 oasr.RestManager.init Initializing
> RestManager with initArgs: {}
>    [junit4]   2> 849747 T2393 oasr.ManagedResourceStorage.load Reading
> _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 849751 T2393
> oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38
> bytes from znode /configs/conf1/_rest_managed.json
>    [junit4]   2> 849751 T2393 oasr.ManagedResourceStorage.load Loaded
> LinkedHashMap at path _rest_managed.json using
> ZooKeeperStorageIO:path=/configs/conf1
>    [junit4]   2> 849751 T2393 oasr.ManagedResource.reloadFromStorage
> Loaded initArgs {} for /rest/managed
>    [junit4]   2> 849752 T2393 oasr.RestManager.init Initializing 0
> registered ManagedResources
>    [junit4]   2> 849752 T2393 oash.ReplicationHandler.inform Commits will
> be reserved for  10000
>    [junit4]   2> 849753 T2393 oasc.CoreContainer.registerCore registering
> core: collection1
>    [junit4]   2> 849755 T2397 oasc.ZkController.register Register replica
> - core:collection1 address:http://127.0.0.1:49865 collection:collection1
> shard:shard1
>    [junit4]   2> 849756 T2394 oasc.SolrCore.registerSearcher [collection1]
> Registered new searcher Searcher@49e1a7c7[collection1]
> main{ExitableDirectoryReader(UninvertingDirectoryReader())}
>    [junit4]   2> 849756 T2316 oass.SolrDispatchFilter.init
> user.dir=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0
>    [junit4]   2> 849758 T2316 oass.SolrDispatchFilter.init
> SolrDispatchFilter.init() done
>    [junit4]   2> 849760 T2397
>
> [...truncated too long message...]
>
> it4]   2> 888022 T2316 oasc.ZkController.unRegisterConfListener  a
> listener was removed because of core close
>    [junit4]   2> 888023 T2316 oasu.DirectUpdateHandler2.close closing
> DirectUpdateHandler2{commits=0,autocommits=0,soft
> autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0,transaction_logs_total_size=0,transaction_logs_total_number=0}
>    [junit4]   2> 888023 T2316 oasu.SolrCoreState.decrefSolrCoreState
> Closing SolrCoreState
>    [junit4]   2> 888023 T2485 oasc.Overseer$ClusterStateUpdater.run
> processMessage: queueSize: 1, message = {
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node4",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49872",
>    [junit4]   2>          "node_name":"127.0.0.1:49872_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"} current state version: 15
>    [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter
> SolrCoreState ref count has reached 0 - closing IndexWriter
>    [junit4]   2> 888024 T2316 oasu.DefaultSolrCoreState.closeIndexWriter
> closing IndexWriter with IndexWriterCloser
>    [junit4]   2> 888025 T2485 oasco.ReplicaMutator.updateState Update
> state numShards=2 message={
>    [junit4]   2>          "core":"collection1",
>    [junit4]   2>          "core_node_name":"core_node4",
>    [junit4]   2>          "roles":null,
>    [junit4]   2>          "base_url":"http://127.0.0.1:49872",
>    [junit4]   2>          "node_name":"127.0.0.1:49872_",
>    [junit4]   2>          "numShards":"2",
>    [junit4]   2>          "state":"down",
>    [junit4]   2>          "shard":"shard1",
>    [junit4]   2>          "collection":"collection1",
>    [junit4]   2>          "operation":"state"}
>    [junit4]   2> 888025 T2316 oasc.SolrCore.closeSearcher [collection1]
> Closing main searcher on request.
>    [junit4]   2> 888031 T2485 oasco.ZkStateWriter.writePendingUpdates
> going to update_collection /collections/collection1/state.json version: 22
>    [junit4]   2> 888039 T2316 oasc.CachingDirectoryFactory.close Closing
> MockDirectoryFactory - 2 directories currently being tracked
>    [junit4]   2> 888040 T2316 oasc.CachingDirectoryFactory.closeCacheValue
> looking to close
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index
> [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index;done=false>>]
>    [junit4]   2> 888041 T2316 oasc.CachingDirectoryFactory.close Closing
> directory:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4/index
>    [junit4]   2> 888042 T2434 oascc.ZkStateReader$7.process A cluster
> state change: WatchedEvent state:SyncConnected type:NodeDataChanged
> path:/collections/collection1/state.json, has occurred - updating...
>    [junit4]   2> 888042 T2316 oasc.CachingDirectoryFactory.closeCacheValue
> looking to close
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4
> [CachedDir<<refCount=0;path=/Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4;done=false>>]
>    [junit4]   2> 888043 T2316 oasc.CachingDirectoryFactory.close Closing
> directory:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001/tempDir-001/jetty4
>    [junit4]   2> 888044 T2316 oasc.Overseer.close Overseer
> (id=93006854147866637-127.0.0.1:49872_-n_0000000004) closing
>    [junit4]   2> 888045 T2485 oasc.Overseer$ClusterStateUpdater.run
> Overseer Loop exiting : 127.0.0.1:49872_
>    [junit4]   2> 889547 T2434 oascc.ZkStateReader$7.process WARN ZooKeeper
> watch triggered, but Solr cannot talk to ZK
>    [junit4]   2> 889548 T2475 oascc.ZkStateReader$3.process WARN ZooKeeper
> watch triggered, but Solr cannot talk to ZK
>    [junit4]   2> 889565 T2316 oejsh.ContextHandler.doStop stopped
> o.e.j.s.ServletContextHandler{/,null}
>    [junit4]   2> 894556 T2316 oas.SolrTestCaseJ4.tearDown ###Ending
> testDistribSearch
>    [junit4]   2> 894558 T2316 oasc.ZkTestServer.send4LetterWord connecting
> to 127.0.0.1:49854 49854
>    [junit4]   2> 894571 T2317 oasc.ZkTestServer.send4LetterWord connecting
> to 127.0.0.1:49854 49854
>    [junit4]   2> 894790 T2317 oasc.ZkTestServer$ZKServerMain.runFromConfig
> WARN Watch limit violations:
>    [junit4]   2>        Maximum concurrent create/delete watches above
> limit:
>    [junit4]   2>
>    [junit4]   2>                10      /solr/configs/conf1
>    [junit4]   2>                6       /solr/aliases.json
>    [junit4]   2>                6       /solr/clusterstate.json
>    [junit4]   2>                4
>  /solr/collections/collection1/state.json
>    [junit4]   2>                2       /solr/configs/.system
>    [junit4]   2>
>    [junit4]   2>        Maximum concurrent children watches above limit:
>    [junit4]   2>
>    [junit4]   2>                6       /solr/live_nodes
>    [junit4]   2>                5
>  /solr/overseer/collection-queue-work
>    [junit4]   2>                4       /solr/overseer/queue
>    [junit4]   2>
>    [junit4]   2> NOTE: reproduce with: ant test
> -Dtestcase=TestDynamicLoading -Dtests.method=testDistribSearch
> -Dtests.seed=CC8AD89B44D0A93D -Dtests.slow=true -Dtests.locale=es_GT
> -Dtests.timezone=America/Kentucky/Louisville -Dtests.asserts=true
> -Dtests.file.encoding=UTF-8
>    [junit4] FAILURE 57.8s | TestDynamicLoading.testDistribSearch <<<
>    [junit4]    > Throwable #1: java.lang.AssertionError: {
>    [junit4]    >   "responseHeader":{
>    [junit4]    >     "status":404,
>    [junit4]    >     "QTime":14},
>    [junit4]    >   "error":{
>    [junit4]    >     "msg":"no such blob or version available: test/1",
>    [junit4]    >     "code":404}}
> expected:<org.apache.solr.core.BlobStoreTestRequestHandler> but was:<null>
>    [junit4]    >        at
> __randomizedtesting.SeedInfo.seed([CC8AD89B44D0A93D:4D6C5683338FC901]:0)
>    [junit4]    >        at
> org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:101)
>    [junit4]    >        at
> org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:64)
>    [junit4]    >        at
> org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
>    [junit4]    >        at java.lang.Thread.run(Thread.java:745)
>    [junit4]   2> 894984 T2316 oas.SolrTestCaseJ4.deleteCore ###deleteCore
>    [junit4]   2> NOTE: leaving temporary files on disk at:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build/solr-core/test/J0/temp/solr.core.TestDynamicLoading-CC8AD89B44D0A93D-001
>    [junit4]   2> 57768 T2315 ccr.ThreadLeakControl.checkThreadLeaks
> WARNING Will linger awaiting termination of 1 leaked thread(s).
>    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50):
> {blobName=PostingsFormat(name=LuceneVarGapFixedInterval),
> _version_=PostingsFormat(name=Memory doPackFST= false),
> id=PostingsFormat(name=Direct), version=PostingsFormat(name=Memory
> doPackFST= false),
> timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{},
> sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=es_GT,
> timezone=America/Kentucky/Louisville
>    [junit4]   2> NOTE: Mac OS X 10.8.5 x86_64/Oracle Corporation 1.8.0_20
> (64-bit)/cpus=2,threads=1,free=139693720,total=288882688
>    [junit4]   2> NOTE: All tests run in this JVM:
> [TestSerializedLuceneMatchVersion, ReplicationFactorTest,
> RAMDirectoryFactoryTest, TestLRUCache, OutputWriterTest, ZkStateWriterTest,
> TestInitParams, TestExpandComponent, CoreAdminCreateDiscoverTest,
> TestCloudSchemaless, MigrateRouteKeyTest, InfoHandlerTest,
> DisMaxRequestHandlerTest, DistributedFacetPivotSmallTest,
> HdfsLockFactoryTest, TestPHPSerializedResponseWriter, CursorPagingTest,
> TestSolrXml, TestClassNameShortening, StressHdfsTest,
> DistributedFacetPivotSmallAdvancedTest, TestIndexSearcher,
> LoggingHandlerTest, TestCoreContainer, ExternalCollectionsTest,
> TestSchemaNameResource, TestBinaryResponseWriter, TestRangeQuery,
> QueryParsingTest, XmlUpdateRequestHandlerTest, TestAddFieldRealTimeGet,
> AnalyticsQueryTest, DistribCursorPagingTest, TestRawResponseWriter,
> ZkSolrClientTest, TestFastWriter, TestDynamicLoading]
>    [junit4] Completed in 58.31s, 1 test, 1 failure <<< FAILURES!
>
> [...truncated 1307 lines...]
> BUILD FAILED
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:519: The
> following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:467: The
> following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/build.xml:61: The
> following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/extra-targets.xml:39:
> The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/build.xml:187: The
> following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/solr/common-build.xml:510:
> The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:1349:
> The following error occurred while executing this line:
> /Users/jenkins/workspace/Lucene-Solr-trunk-MacOSX/lucene/common-build.xml:956:
> There were test failures: 453 suites, 1850 tests, 1 failure, 37 ignored (21
> assumptions)
>
> Total time: 166 minutes 36 seconds
> Build step 'Invoke Ant' marked build as failure
> [description-setter] Description set: Java: 64bit/jdk1.8.0
> -XX:+UseCompressedOops -XX:+UseParallelGC (asserts: true)
> Archiving artifacts
> Recording test results
> Email was triggered for: Failure - Any
> Sending email for trigger: Failure - Any
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>



-- 
Regards,
Shalin Shekhar Mangar.