You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/01/14 13:10:15 UTC

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_40-ea-b20) - Build # 11600 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11600/
Java: 32bit/jdk1.8.0_40-ea-b20 -server -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.core.TestDynamicLoading.testDistribSearch

Error Message:
Could not successfully add blob after 150 attempts. Expecting 2 items. time elapsed 15,836  output  for url is {   "responseHeader":{     "status":0,     "QTime":1},   "response":{     "numFound":1,     "start":0,     "docs":[{         "id":"test/1",         "md5":"6f2aff6e4f223bc7ee3a473c19b3bcf3",         "blobName":"test",         "version":1,         "timestamp":"2015-01-14T11:38:24.898Z",         "size":5318}]}}

Stack Trace:
java.lang.AssertionError: Could not successfully add blob after 150 attempts. Expecting 2 items. time elapsed 15,836  output  for url is {
  "responseHeader":{
    "status":0,
    "QTime":1},
  "response":{
    "numFound":1,
    "start":0,
    "docs":[{
        "id":"test/1",
        "md5":"6f2aff6e4f223bc7ee3a473c19b3bcf3",
        "blobName":"test",
        "version":1,
        "timestamp":"2015-01-14T11:38:24.898Z",
        "size":5318}]}}
	at __randomizedtesting.SeedInfo.seed([29608FE21F7C6F73:A88601FA68230F4F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.handler.TestBlobHandler.postAndCheck(TestBlobHandler.java:150)
	at org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:114)
	at org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:70)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 8896 lines...]
   [junit4] Suite: org.apache.solr.core.TestDynamicLoading
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/init-core-data-001
   [junit4]   2> 130781 T655 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 130781 T655 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /swu/
   [junit4]   2> 130784 T655 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 130785 T655 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 130785 T656 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 130885 T655 oasc.ZkTestServer.run start zk server on port:43139
   [junit4]   2> 130885 T655 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 130886 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 130889 T663 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@80d2b6 name:ZooKeeperConnection Watcher:127.0.0.1:43139 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 130891 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 130892 T655 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 130892 T655 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 130895 T655 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 130896 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 130897 T666 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@116b5b2 name:ZooKeeperConnection Watcher:127.0.0.1:43139/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 130897 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 130898 T655 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 130898 T655 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 130906 T655 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 130908 T655 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 130910 T655 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 130911 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 130912 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 130914 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 130914 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 130916 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 130916 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 130917 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 130918 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 130919 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 130919 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 130921 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 130921 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 130922 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 130923 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 130924 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 130924 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 130926 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 130926 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 130927 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 130928 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 130929 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 130929 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 131310 T655 oejs.Server.doStart jetty-9.2.6.v20141205
   [junit4]   2> 131318 T655 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@676e5e{/swu,null,AVAILABLE}
   [junit4]   2> 131324 T655 oejs.AbstractConnector.doStart Started ServerConnector@175ce87{HTTP/1.1}{127.0.0.1:33452}
   [junit4]   2> 131325 T655 oejs.Server.doStart Started @132365ms
   [junit4]   2> 131326 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@e2f2a
   [junit4]   2> 131326 T655 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 131326 T655 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-002
   [junit4]   2> 131327 T655 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-002/'
   [junit4]   2> 131346 T655 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-002/solr.xml
   [junit4]   2> 131365 T655 oasc.CoreContainer.<init> New CoreContainer 33262438
   [junit4]   2> 131365 T655 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-002/]
   [junit4]   2> 131366 T655 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 131366 T655 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 131367 T655 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 131367 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 131367 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 131368 T655 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 131368 T655 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 131368 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 131368 T655 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 131369 T655 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 131369 T655 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 131369 T655 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 131370 T655 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 131370 T655 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 131370 T655 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43139/solr
   [junit4]   2> 131370 T655 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 131371 T655 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 131375 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 131382 T680 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16be0fa name:ZooKeeperConnection Watcher:127.0.0.1:43139 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 131382 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 131383 T655 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 131389 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 131391 T683 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@155b4af name:ZooKeeperConnection Watcher:127.0.0.1:43139/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 131392 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 131393 T655 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 131396 T655 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 131399 T655 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 131400 T655 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 131402 T655 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 131405 T655 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 131406 T655 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33452_swu
   [junit4]   2> 131407 T655 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:33452_swu
   [junit4]   2> 131409 T655 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 131410 T655 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 131412 T655 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 131414 T655 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:33452_swu
   [junit4]   2> 131414 T655 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 131416 T655 oasc.Overseer.start Overseer (id=93142089120808963-127.0.0.1:33452_swu-n_0000000000) starting
   [junit4]   2> 131418 T655 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 131425 T655 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 131425 T685 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 131426 T655 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 131428 T655 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 131430 T655 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 131432 T684 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 131433 T687 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 131434 T687 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 131434 T683 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 131434 T687 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 131436 T684 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 0, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:33452/swu",
   [junit4]   2> 	  "node_name":"127.0.0.1:33452_swu",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 0
   [junit4]   2> 131436 T684 oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:33452/swu",
   [junit4]   2> 	  "node_name":"127.0.0.1:33452_swu",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 131436 T684 oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 131436 T684 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 131437 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 132435 T687 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 132435 T687 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 132436 T687 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 132436 T687 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 132437 T687 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 132437 T687 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-002/collection1/'
   [junit4]   2> 132437 T687 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading%2029608FE21F7C6F73-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 132438 T687 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading%2029608FE21F7C6F73-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 132438 T687 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading%2029608FE21F7C6F73-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 132456 T687 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 132457 T687 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 132464 T687 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 132469 T687 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 132484 T687 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 132486 T687 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 132493 T687 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 132637 T687 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 132645 T687 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 132647 T687 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 132662 T687 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 132664 T687 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 132666 T687 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 132667 T687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 132668 T687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 132668 T687 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 132669 T687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 132670 T687 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 132670 T687 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 132670 T687 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 132670 T687 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/control/data/
   [junit4]   2> 132671 T687 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@154461a
   [junit4]   2> 132671 T687 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/control/data
   [junit4]   2> 132672 T687 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/control/data/index/
   [junit4]   2> 132672 T687 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 132672 T687 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/control/data/index
   [junit4]   2> 132673 T687 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=90.6337890625, floorSegmentMB=0.6328125, forceMergeDeletesPctAllowed=27.316171053162027, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3046154381023752
   [junit4]   2> 132673 T687 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@567df8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5879bf),segFN=segments_1,generation=1}
   [junit4]   2> 132674 T687 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 132677 T687 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 132677 T687 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 132678 T687 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 132678 T687 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 132678 T687 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 132678 T687 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 132679 T687 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 132679 T687 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 132679 T687 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 132680 T687 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 132680 T687 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 132680 T687 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 132681 T687 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 132681 T687 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 132681 T687 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 132681 T687 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 132682 T687 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 132682 T687 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 132682 T687 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 132683 T687 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 132683 T687 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 132683 T687 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 132683 T687 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 132684 T687 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 132684 T687 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 132684 T687 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 132684 T687 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 132686 T687 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 132687 T687 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 132690 T687 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 132691 T687 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 132692 T687 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 132698 T687 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 132698 T687 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 132699 T687 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=4.748046875, floorSegmentMB=0.3701171875, forceMergeDeletesPctAllowed=6.59038413671181, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8223064767464748
   [junit4]   2> 132699 T687 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@567df8 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@5879bf),segFN=segments_1,generation=1}
   [junit4]   2> 132699 T687 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 132700 T687 oass.SolrIndexSearcher.<init> Opening Searcher@bc600c[collection1] main
   [junit4]   2> 132700 T687 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 132700 T687 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 132701 T687 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 132701 T687 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 132701 T687 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 132702 T687 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 132702 T687 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 132704 T687 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 132705 T687 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 132705 T687 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 132706 T687 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 132707 T688 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@bc600c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 132708 T691 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:33452/swu collection:control_collection shard:shard1
   [junit4]   2> 132708 T655 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 132708 T691 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 132708 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 132709 T655 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 132709 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 132711 T694 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f5baea name:ZooKeeperConnection Watcher:127.0.0.1:43139/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 132711 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 132711 T691 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 132712 T655 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 132712 T683 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 132712 T655 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 132713 T691 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 132713 T691 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C315 name=collection1 org.apache.solr.core.SolrCore@754d63 url=http://127.0.0.1:33452/swu/collection1 node=127.0.0.1:33452_swu C315_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:33452/swu, node_name=127.0.0.1:33452_swu, state=down}
   [junit4]   2> 132713 T691 C315 P33452 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:33452/swu/collection1/
   [junit4]   2> 132713 T691 C315 P33452 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 132713 T691 C315 P33452 oasc.SyncStrategy.syncToMe http://127.0.0.1:33452/swu/collection1/ has no replicas
   [junit4]   2> 132714 T691 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:33452/swu/collection1/ shard1
   [junit4]   2> 132714 T691 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 132714 T684 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 132714 T655 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 132714 T655 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 132715 T655 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 132715 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 132716 T697 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1585206 name:ZooKeeperConnection Watcher:127.0.0.1:43139/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 132717 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 132717 T655 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 132718 T683 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 132718 T684 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:33452/swu",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 1
   [junit4]   2> 132720 T684 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"create",
   [junit4]   2> 	  "name":"collection1",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "stateFormat":2} current state version: 1
   [junit4]   2> 132720 T684 oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 132721 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 132721 T694 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 132725 T698 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 132725 T684 oasco.ZkStateWriter.writePendingUpdates going to create_collection /collections/collection1/state.json
   [junit4]   2> 132725 T694 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 132768 T691 oasc.ZkController.register We are http://127.0.0.1:33452/swu/collection1/ and leader is http://127.0.0.1:33452/swu/collection1/
   [junit4]   2> 132768 T691 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:33452/swu
   [junit4]   2> 132769 T691 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 132769 T691 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 132769 T691 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 132770 T683 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 132775 T684 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:33452/swu",
   [junit4]   2> 	  "node_name":"127.0.0.1:33452_swu",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"} current state version: 3
   [junit4]   2> 132775 T684 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:33452/swu",
   [junit4]   2> 	  "node_name":"127.0.0.1:33452_swu",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 132882 T694 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 132882 T683 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 133102 T655 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 133103 T655 oejs.Server.doStart jetty-9.2.6.v20141205
   [junit4]   2> 133112 T655 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@772a90{/swu,null,AVAILABLE}
   [junit4]   2> 133113 T655 oejs.AbstractConnector.doStart Started ServerConnector@16d6e88{HTTP/1.1}{127.0.0.1:52048}
   [junit4]   2> 133113 T655 oejs.Server.doStart Started @134153ms
   [junit4]   2> 133114 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@e2f2a
   [junit4]   2> 133114 T655 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 133114 T655 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-003
   [junit4]   2> 133114 T655 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-003/'
   [junit4]   2> 133127 T655 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-003/solr.xml
   [junit4]   2> 133146 T655 oasc.CoreContainer.<init> New CoreContainer 2956588
   [junit4]   2> 133146 T655 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-003/]
   [junit4]   2> 133147 T655 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 133147 T655 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 133148 T655 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 133148 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 133149 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 133149 T655 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 133149 T655 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 133150 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 133150 T655 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 133151 T655 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 133152 T655 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 133152 T655 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 133152 T655 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 133153 T655 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 133153 T655 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43139/solr
   [junit4]   2> 133154 T655 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 133154 T655 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 133155 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 133161 T712 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a672b5 name:ZooKeeperConnection Watcher:127.0.0.1:43139 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 133161 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 133162 T655 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 133176 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 133178 T715 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10eb76b name:ZooKeeperConnection Watcher:127.0.0.1:43139/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 133179 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 133183 T655 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 134190 T655 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:52048_swu
   [junit4]   2> 134192 T655 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:52048_swu
   [junit4]   2> 134201 T655 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 134211 T716 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 134211 T716 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 134213 T683 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 134214 T684 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:52048/swu",
   [junit4]   2> 	  "node_name":"127.0.0.1:52048_swu",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 134215 T684 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:52048/swu",
   [junit4]   2> 	  "node_name":"127.0.0.1:52048_swu",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 134215 T716 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 134216 T684 oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 134216 T716 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 134216 T684 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 134216 T716 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 134217 T716 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0 
   [junit4]   2> 134217 T716 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 134318 T684 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 134319 T715 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 134320 T715 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1 
   [junit4]   2> 135217 T716 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 135218 T716 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 135218 T716 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 135219 T716 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 135219 T716 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 135220 T716 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-003/collection1/'
   [junit4]   2> 135221 T716 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading%2029608FE21F7C6F73-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 135222 T716 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading%2029608FE21F7C6F73-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 135222 T716 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading%2029608FE21F7C6F73-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 135244 T716 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 135249 T716 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 135256 T716 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 135264 T716 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 135285 T716 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 135286 T716 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 135291 T716 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 135441 T716 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 135452 T716 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 135453 T716 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 135460 T716 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 135462 T716 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 135464 T716 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 135477 T716 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 135477 T716 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 135478 T716 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 135478 T716 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 135478 T716 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 135479 T716 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 135479 T716 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 135479 T716 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/jetty1/
   [junit4]   2> 135479 T716 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@154461a
   [junit4]   2> 135480 T716 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/jetty1
   [junit4]   2> 135480 T716 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/jetty1/index/
   [junit4]   2> 135480 T716 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 135481 T716 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/jetty1/index
   [junit4]   2> 135487 T716 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=90.6337890625, floorSegmentMB=0.6328125, forceMergeDeletesPctAllowed=27.316171053162027, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3046154381023752
   [junit4]   2> 135488 T716 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@170532f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1940744),segFN=segments_1,generation=1}
   [junit4]   2> 135488 T716 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 135497 T716 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 135498 T716 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 135498 T716 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 135498 T716 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 135498 T716 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 135498 T716 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 135499 T716 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 135499 T716 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 135499 T716 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 135500 T716 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 135500 T716 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 135501 T716 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 135504 T716 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 135505 T716 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 135505 T716 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 135506 T716 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 135506 T716 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 135507 T716 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 135509 T716 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 135514 T716 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 135514 T716 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 135515 T716 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 135515 T716 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 135516 T716 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 135516 T716 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 135516 T716 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 135517 T716 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 135519 T716 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 135521 T716 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 135522 T716 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 135523 T716 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 135523 T716 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 135524 T716 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 135525 T716 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 135528 T716 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=4.748046875, floorSegmentMB=0.3701171875, forceMergeDeletesPctAllowed=6.59038413671181, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8223064767464748
   [junit4]   2> 135528 T716 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@170532f lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@1940744),segFN=segments_1,generation=1}
   [junit4]   2> 135529 T716 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 135529 T716 oass.SolrIndexSearcher.<init> Opening Searcher@1a6ea6e[collection1] main
   [junit4]   2> 135529 T716 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 135530 T716 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 135530 T716 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 135531 T716 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 135531 T716 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 135531 T716 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 135532 T716 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 135532 T716 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 135532 T716 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 135532 T716 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 135533 T716 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 135534 T720 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:52048/swu collection:collection1 shard:shard2
   [junit4]   2> 135535 T655 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 135535 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 135535 T720 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 135537 T717 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1a6ea6e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 135539 T720 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 135540 T683 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 135540 T720 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 135541 T720 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C316 name=collection1 org.apache.solr.core.SolrCore@6acd0e url=http://127.0.0.1:52048/swu/collection1 node=127.0.0.1:52048_swu C316_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:52048/swu, node_name=127.0.0.1:52048_swu, state=down}
   [junit4]   2> 135541 T720 C316 P52048 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:52048/swu/collection1/
   [junit4]   2> 135541 T684 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"} current state version: 4
   [junit4]   2> 135541 T720 C316 P52048 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 135542 T720 C316 P52048 oasc.SyncStrategy.syncToMe http://127.0.0.1:52048/swu/collection1/ has no replicas
   [junit4]   2> 135542 T720 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:52048/swu/collection1/ shard2
   [junit4]   2> 135542 T720 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 135542 T684 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 1
   [junit4]   2> 135543 T715 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 135544 T715 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2 
   [junit4]   2> 135547 T683 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 135548 T684 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:52048/swu",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 4
   [junit4]   2> 135549 T684 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 2
   [junit4]   2> 135549 T715 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 135550 T715 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 135598 T720 oasc.ZkController.register We are http://127.0.0.1:52048/swu/collection1/ and leader is http://127.0.0.1:52048/swu/collection1/
   [junit4]   2> 135599 T720 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:52048/swu
   [junit4]   2> 135599 T720 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 135599 T720 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 135599 T720 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 135600 T683 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 135601 T684 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:52048/swu",
   [junit4]   2> 	  "node_name":"127.0.0.1:52048_swu",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 135602 T684 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:52048/swu",
   [junit4]   2> 	  "node_name":"127.0.0.1:52048_swu",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 135603 T684 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 3
   [junit4]   2> 135603 T715 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 135604 T720 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 135604 T715 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 135893 T655 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 135894 T655 oejs.Server.doStart jetty-9.2.6.v20141205
   [junit4]   2> 135899 T655 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@1ebe84{/swu,null,AVAILABLE}
   [junit4]   2> 135900 T655 oejs.AbstractConnector.doStart Started ServerConnector@199bddb{HTTP/1.1}{127.0.0.1:45112}
   [junit4]   2> 135900 T655 oejs.Server.doStart Started @136941ms
   [junit4]   2> 135901 T655 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@e2f2a
   [junit4]   2> 135902 T655 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 135902 T655 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-004
   [junit4]   2> 135903 T655 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-004/'
   [junit4]   2> 135916 T655 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-004/solr.xml
   [junit4]   2> 135929 T655 oasc.CoreContainer.<init> New CoreContainer 5679888
   [junit4]   2> 135929 T655 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-004/]
   [junit4]   2> 135930 T655 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 135930 T655 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 135931 T655 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 135931 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 135931 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxConnections to: 10000
   [junit4]   2> 135932 T655 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 135932 T655 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 135933 T655 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 135933 T655 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 135934 T655 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 135934 T655 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 135935 T655 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 135935 T655 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 135935 T655 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 135936 T655 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:43139/solr
   [junit4]   2> 135936 T655 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 135937 T655 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 135937 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 135942 T734 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@115c6c7 name:ZooKeeperConnection Watcher:127.0.0.1:43139 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 135943 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 135944 T655 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 135946 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 135955 T737 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e0739 name:ZooKeeperConnection Watcher:127.0.0.1:43139/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 135956 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 135969 T655 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 136983 T655 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45112_swu
   [junit4]   2> 136983 T655 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:45112_swu
   [junit4]   2> 136988 T655 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 136995 T738 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 136995 T738 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 136998 T683 oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 136999 T684 oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:45112/swu",
   [junit4]   2> 	  "node_name":"127.0.0.1:45112_swu",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"} current state version: 4
   [junit4]   2> 136999 T684 oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:45112/swu",
   [junit4]   2> 	  "node_name":"127.0.0.1:45112_swu",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 137000 T684 oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 137000 T684 oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 137001 T684 oasco.ZkStateWriter.writePendingUpdates going to update_collection /collections/collection1/state.json version: 4
   [junit4]   2> 137002 T715 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 137003 T715 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 137003 T738 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 137003 T738 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 137004 T738 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 137006 T738 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 137007 T738 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 137007 T738 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 137007 T738 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 137007 T738 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 137008 T738 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 137009 T738 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 137009 T738 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-004/collection1/'
   [junit4]   2> 137010 T738 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading%2029608FE21F7C6F73-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 137010 T738 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading%2029608FE21F7C6F73-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 137011 T738 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading%2029608FE21F7C6F73-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 137027 T738 oasc.ZkController.watchZKConfDir watch zkdir /configs/conf1
   [junit4]   2> 137030 T738 oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 137035 T738 oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 137045 T738 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 137064 T738 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 137068 T738 oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 137074 T738 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 137207 T738 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 137211 T738 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 137212 T738 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 137220 T738 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 137222 T738 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 137225 T738 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 137225 T738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 137226 T738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 137226 T738 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 137229 T738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 137229 T738 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 137229 T738 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 137230 T738 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 137230 T738 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/jetty2/
   [junit4]   2> 137230 T738 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@154461a
   [junit4]   2> 137231 T738 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/jetty2
   [junit4]   2> 137231 T738 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/jetty2/index/
   [junit4]   2> 137231 T738 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 137232 T738 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001/tempDir-001/jetty2/index
   [junit4]   2> 137232 T738 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=10, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=90.6337890625, floorSegmentMB=0.6328125, forceMergeDeletesPctAllowed=27.316171053162027, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3046154381023752
   [junit4]   2> 137232 T738 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@b346f3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d63939),segFN=segments_1,generation=1}
   [junit4]   2> 137233 T738 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 137236 T738 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 137236 T738 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 137236 T738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 137237 T738 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 137237 T738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 137237 T738 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 137237 T738 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 137238 T738 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 137238 T738 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 137238 T738 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 137239 T738 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 137239 T738 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 137240 T738 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 137240 T738 oasc.RequestHandlers.initHandlersFromConfig created /config: org.apache.solr.handler.SolrConfigHandler
   [junit4]   2> 137240 T738 oasc.RequestHandlers.initHandlersFromConfig created /schema: org.apache.solr.handler.SchemaHandler
   [junit4]   2> 137241 T738 oasc.RequestHandlers.initHandlersFromConfig created /replication: org.apache.solr.handler.ReplicationHandler
   [junit4]   2> 137242 T738 oasc.RequestHandlers.initHandlersFromConfig created /get: org.apache.solr.handler.RealTimeGetHandler
   [junit4]   2> 137247 T738 oasc.RequestHandlers.initHandlersFromConfig created /admin/luke: org.apache.solr.handler.admin.LukeRequestHandler
   [junit4]   2> 137247 T738 oasc.RequestHandlers.initHandlersFromConfig created /admin/system: org.apache.solr.handler.admin.SystemInfoHandler
   [junit4]   2> 137248 T738 oasc.RequestHandlers.initHandlersFromConfig created /admin/mbeans: org.apache.solr.handler.admin.SolrInfoMBeanHandler
   [junit4]   2> 137248 T738 oasc.RequestHandlers.initHandlersFromConfig created /admin/plugins: org.apache.solr.handler.admin.PluginInfoHandler
   [junit4]   2> 137249 T738 oasc.RequestHandlers.initHandlersFromConfig created /admin/threads: org.apache.solr.handler.admin.ThreadDumpHandler
   [junit4]   2> 137249 T738 oasc.RequestHandlers.initHandlersFromConfig created /admin/properties: org.apache.solr.handler.admin.PropertiesRequestHandler
   [junit4]   2> 137250 T738 oasc.RequestHandlers.initHandlersFromConfig created /admin/logging: org.apache.solr.handler.admin.LoggingHandler
   [junit4]   2> 137250 T738 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: org.apache.solr.handler.PingRequestHandler
   [junit4]   2> 137251 T738 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 137251 T738 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 137259 T738 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 137260 T738 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 137261 T738 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 137262 T738 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 137263 T738 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 137264 T738 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 137264 T738 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 137265 T738 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=4.748046875, floorSegmentMB=0.3701171875, forceMergeDeletesPctAllowed=6.59038413671181, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8223064767464748
   [junit4]   2> 137266 T738 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@b346f3 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@d63939),segFN=segments_1,generation=1}
   [junit4]   2> 137266 T738 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 137266 T738 oass.SolrIndexSearcher.<init> Opening Searcher@c4165[collection1] main
   [junit4]   2> 137266 T738 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 137267 T738 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 137267 T738 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 137268 T738 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 137268 T738 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 137268 T738 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 137268 T738 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 137269 T738 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 137269 T738 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 137269 T738 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 137270 T739 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@c4165[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 137271 T738 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 137273 T742 oasc.ZkController.register Register replica - cor

[...truncated too long message...]

38:24.898Z",
   [junit4]    >         "size":5318}]}}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([29608FE21F7C6F73:A88601FA68230F4F]:0)
   [junit4]    > 	at org.apache.solr.handler.TestBlobHandler.postAndCheck(TestBlobHandler.java:150)
   [junit4]    > 	at org.apache.solr.core.TestDynamicLoading.dynamicLoading(TestDynamicLoading.java:114)
   [junit4]    > 	at org.apache.solr.core.TestDynamicLoading.doTest(TestDynamicLoading.java:70)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:868)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 169266 T655 oas.SolrTestCaseJ4.setUp ###Starting testDown
   [junit4]   2> 169267 T655 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 169268 T853 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 169368 T655 oasc.ZkTestServer.run start zk server on port:56697
   [junit4]   2> 169369 T655 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 169370 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 169373 T860 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1f96b44 name:ZooKeeperConnection Watcher:127.0.0.1:56697 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 169373 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 169374 T655 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 169374 T655 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 169380 T655 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 169382 T655 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 169392 T863 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@649eba name:ZooKeeperConnection Watcher:127.0.0.1:56697/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 169392 T655 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 169393 T655 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 169393 T655 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 169397 T655 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 169399 T655 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 169403 T655 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 169406 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 169406 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 169408 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 169409 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 169413 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 169414 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 169415 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 169416 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 169417 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 169417 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 169418 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 169419 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 169420 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 169420 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 169421 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 169422 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 169423 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 169423 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 169426 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 169427 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 169432 T655 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 169433 T655 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 169439 T655 oas.SolrTestCaseJ4.tearDown ###Ending testDown
   [junit4]   2> 169440 T655 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:56697 56697
   [junit4]   2> 170115 T853 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:56697 56697
   [junit4]   2> 170117 T655 oas.SolrTestCaseJ4.tearDown ###Ending testDown
   [junit4]   2> 170118 T655 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:56697 56697
   [junit4]   2> 170119 T655 oas.SolrTestCaseJ4.tearDown ###Ending testDown
   [junit4]   2> 170119 T655 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:56697 56697
   [junit4]   2> 170123 T655 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.TestDynamicLoading 29608FE21F7C6F73-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {blobName=Lucene50(blocksize=128), size=BlockTreeOrds(blocksize=128), _version_=PostingsFormat(name=LuceneVarGapFixedInterval), id=PostingsFormat(name=Memory doPackFST= false), version=Lucene50(blocksize=128), md5=PostingsFormat(name=LuceneVarGapFixedInterval), timestamp=PostingsFormat(name=LuceneVarGapFixedInterval)}, docValues:{}, sim=DefaultSimilarity, locale=iw_IL, timezone=Asia/Istanbul
   [junit4]   2> NOTE: Linux 3.13.0-43-generic i386/Oracle Corporation 1.8.0_40-ea (32-bit)/cpus=8,threads=1,free=24456808,total=82198528
   [junit4]   2> NOTE: All tests run in this JVM: [DirectUpdateHandlerOptimizeTest, TestRangeQuery, TestRawResponseWriter, TestOrdValues, TestManagedSchema, MigrateRouteKeyTest, BufferStoreTest, BinaryUpdateRequestHandlerTest, QueryParsingTest, CurrencyFieldOpenExchangeTest, TestLuceneMatchVersion, TestFieldTypeCollectionResource, TestSolrDynamicMBean, BadIndexSchemaTest, AliasIntegrationTest, TestTolerantSearch, TestTrie, TestSolr4Spatial, TestFieldSortValues, QueryEqualityTest, ReturnFieldsTest, HighlighterMaxOffsetTest, SampleTest, TestExpandComponent, DistanceUnitsTest, TestPostingsSolrHighlighter, TestDynamicLoading]
   [junit4] Completed on J1 in 39.38s, 2 tests, 1 failure <<< FAILURES!

[...truncated 1321 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:519: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:467: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:187: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:510: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1348: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:956: There were test failures: 463 suites, 1870 tests, 1 failure, 47 ignored (21 assumptions)

Total time: 64 minutes 31 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b20 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any