You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2014/09/29 10:51:14 UTC

[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.9.0-ea-b28) - Build # 11347 - Still Failing!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11347/
Java: 32bit/jdk1.9.0-ea-b28 -server -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.testDistribSearch

Error Message:
Doc with id=2 not found in http://127.0.0.1:37774/nm_uc/c8n_1x2_leader_session_loss due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=2 not found in http://127.0.0.1:37774/nm_uc/c8n_1x2_leader_session_loss due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([FC05035FA51DFD06:7DE38D47D2429D3A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:437)
	at org.apache.solr.cloud.HttpPartitionTest.testLeaderZkSessionLoss(HttpPartitionTest.java:324)
	at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:119)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.GeneratedMethodAccessor36.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:484)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11411 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/init-core-data-001
   [junit4]   2> 1528641 T4099 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /nm_uc/
   [junit4]   2> 1528643 T4099 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1528643 T4099 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1528644 T4100 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1528744 T4099 oasc.ZkTestServer.run start zk server on port:47741
   [junit4]   2> 1528744 T4099 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1528745 T4099 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1528747 T4106 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@155bac9 name:ZooKeeperConnection Watcher:127.0.0.1:47741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1528747 T4099 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1528748 T4099 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1528748 T4099 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1528752 T4099 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1528753 T4099 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1528755 T4108 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@186fe86 name:ZooKeeperConnection Watcher:127.0.0.1:47741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1528755 T4099 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1528755 T4099 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1528756 T4099 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1528760 T4099 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1528763 T4099 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1528765 T4099 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1528768 T4099 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1528769 T4099 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1528772 T4099 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1528773 T4099 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1528776 T4099 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1528777 T4099 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1528780 T4099 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1528781 T4099 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1528783 T4099 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1528784 T4099 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1528786 T4099 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1528787 T4099 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1528789 T4099 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1528789 T4099 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1528792 T4099 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1528792 T4099 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1528795 T4099 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1528795 T4099 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1528798 T4099 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1528798 T4099 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1528800 T4099 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1528801 T4099 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1529049 T4099 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1529053 T4099 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:57876
   [junit4]   2> 1529054 T4099 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1529054 T4099 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1529054 T4099 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-002
   [junit4]   2> 1529055 T4099 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-002/'
   [junit4]   2> 1529065 T4099 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-002/solr.xml
   [junit4]   2> 1529079 T4099 oasc.CoreContainer.<init> New CoreContainer 82077
   [junit4]   2> 1529080 T4099 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-002/]
   [junit4]   2> 1529081 T4099 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1529081 T4099 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1529081 T4099 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1529082 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1529082 T4099 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1529083 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1529083 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1529083 T4099 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1529084 T4099 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1529084 T4099 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1529085 T4099 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1529085 T4099 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1529086 T4099 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1529086 T4099 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:47741/solr
   [junit4]   2> 1529087 T4099 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1529087 T4099 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1529088 T4099 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1529090 T4119 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1fc8866 name:ZooKeeperConnection Watcher:127.0.0.1:47741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1529090 T4099 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1529091 T4099 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1529094 T4099 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1529094 T4121 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@10c8991 name:ZooKeeperConnection Watcher:127.0.0.1:47741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1529095 T4099 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1529096 T4099 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1529099 T4099 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1529102 T4099 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1529104 T4099 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1529107 T4099 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1529109 T4099 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1529111 T4099 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51489_nm_uc
   [junit4]   2> 1529112 T4099 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51489_nm_uc
   [junit4]   2> 1529114 T4099 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1529115 T4099 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1529117 T4099 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1529119 T4099 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:51489_nm_uc
   [junit4]   2> 1529119 T4099 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1529122 T4099 oasc.Overseer.start Overseer (id=92535479001481219-127.0.0.1:51489_nm_uc-n_0000000000) starting
   [junit4]   2> 1529124 T4099 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1529129 T4099 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1529129 T4123 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1529130 T4099 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1529131 T4099 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1529132 T4099 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1529134 T4122 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1529135 T4125 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1529135 T4125 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1529136 T4125 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1529136 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1529137 T4122 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51489/nm_uc",
   [junit4]   2> 	  "node_name":"127.0.0.1:51489_nm_uc",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1529138 T4122 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1529138 T4122 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1
   [junit4]   2> 1529138 T4122 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1529139 T4126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1530136 T4125 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1530136 T4125 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1530137 T4125 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1530137 T4125 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1530138 T4125 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1530139 T4125 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-002/collection1/'
   [junit4]   2> 1530140 T4125 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 1530140 T4125 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 1530140 T4125 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 1530166 T4125 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1530177 T4125 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1530179 T4125 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1530184 T4125 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1530283 T4125 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1530286 T4125 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1530288 T4125 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1530298 T4125 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1530300 T4125 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1530303 T4125 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1530304 T4125 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1530305 T4125 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1530305 T4125 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1530306 T4125 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1530307 T4125 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1530307 T4125 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1530307 T4125 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1530307 T4125 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/control/data/
   [junit4]   2> 1530308 T4125 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@156f0f2
   [junit4]   2> 1530309 T4125 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/control/data
   [junit4]   2> 1530309 T4125 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/control/data/index/
   [junit4]   2> 1530309 T4125 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1530310 T4125 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/control/data/index
   [junit4]   2> 1530310 T4125 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=13.125, floorSegmentMB=1.197265625, forceMergeDeletesPctAllowed=7.335144323560813, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5195369018411685
   [junit4]   2> 1530311 T4125 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-80ca7b)),segFN=segments_1,generation=1}
   [junit4]   2> 1530311 T4125 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1530314 T4125 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1530315 T4125 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1530315 T4125 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1530315 T4125 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1530316 T4125 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1530316 T4125 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1530316 T4125 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1530317 T4125 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1530317 T4125 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1530317 T4125 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1530318 T4125 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1530318 T4125 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1530319 T4125 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1530319 T4125 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1530319 T4125 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1530320 T4125 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1530320 T4125 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1530320 T4125 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1530321 T4125 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1530321 T4125 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1530323 T4125 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1530324 T4125 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1530325 T4125 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1530326 T4125 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1530328 T4125 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1530328 T4125 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1530329 T4125 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=32.349609375, floorSegmentMB=2.0556640625, forceMergeDeletesPctAllowed=24.71840644636208, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.723183819425404
   [junit4]   2> 1530329 T4125 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-80ca7b)),segFN=segments_1,generation=1}
   [junit4]   2> 1530329 T4125 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1530330 T4125 oass.SolrIndexSearcher.<init> Opening Searcher@1e15487[collection1] main
   [junit4]   2> 1530330 T4125 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1530331 T4125 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1530331 T4125 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1530331 T4125 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1530332 T4125 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1530332 T4125 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1530333 T4125 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1530333 T4125 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1530333 T4125 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 1530336 T4125 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1530336 T4125 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1530336 T4125 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1530338 T4128 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e15487[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1530339 T4125 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1530339 T4131 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51489/nm_uc collection:control_collection shard:shard1
   [junit4]   2> 1530340 T4099 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1530341 T4099 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1530340 T4131 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1530342 T4099 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1530343 T4099 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1530344 T4134 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@11ebb0a name:ZooKeeperConnection Watcher:127.0.0.1:47741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1530344 T4099 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1530344 T4099 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1530345 T4131 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1530345 T4099 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1530346 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1530346 T4131 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1530347 T4131 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C4356 name=collection1 org.apache.solr.core.SolrCore@1e348b3 url=http://127.0.0.1:51489/nm_uc/collection1 node=127.0.0.1:51489_nm_uc C4356_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=http://127.0.0.1:51489/nm_uc, node_name=127.0.0.1:51489_nm_uc, state=down}
   [junit4]   2> 1530347 T4131 C4356 P51489 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51489/nm_uc/collection1/
   [junit4]   2> 1530347 T4131 C4356 P51489 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1530347 T4131 C4356 P51489 oasc.SyncStrategy.syncToMe http://127.0.0.1:51489/nm_uc/collection1/ has no replicas
   [junit4]   2> 1530347 T4099 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1530347 T4131 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51489/nm_uc/collection1/ shard1
   [junit4]   2> 1530348 T4099 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 1530348 T4099 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1530349 T4131 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1530349 T4099 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1530349 T4136 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@f3e179 name:ZooKeeperConnection Watcher:127.0.0.1:47741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1530349 T4099 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1530350 T4099 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1530351 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1530352 T4122 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1
   [junit4]   2> 1530352 T4122 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 1530352 T4122 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
   [junit4]   2> 1530354 T4122 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json
   [junit4]   2> 1530354 T4126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1530355 T4137 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1530360 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1530361 T4126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1530361 T4137 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1530402 T4131 oasc.ZkController.register We are http://127.0.0.1:51489/nm_uc/collection1/ and leader is http://127.0.0.1:51489/nm_uc/collection1/
   [junit4]   2> 1530403 T4131 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51489/nm_uc
   [junit4]   2> 1530403 T4131 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1530403 T4131 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1530403 T4131 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1530404 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1530406 T4122 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51489/nm_uc",
   [junit4]   2> 	  "node_name":"127.0.0.1:51489_nm_uc",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1530508 T4137 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1530508 T4126 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1530626 T4099 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1530627 T4099 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1530628 T4099 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43740
   [junit4]   2> 1530629 T4099 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1530629 T4099 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1530630 T4099 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-003
   [junit4]   2> 1530630 T4099 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-003/'
   [junit4]   2> 1530639 T4099 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-003/solr.xml
   [junit4]   2> 1530645 T4099 oasc.CoreContainer.<init> New CoreContainer 16404508
   [junit4]   2> 1530646 T4099 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-003/]
   [junit4]   2> 1530646 T4099 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1530646 T4099 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1530647 T4099 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1530647 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1530647 T4099 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1530648 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1530648 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1530648 T4099 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1530648 T4099 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1530649 T4099 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1530649 T4099 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1530649 T4099 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1530650 T4099 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1530650 T4099 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:47741/solr
   [junit4]   2> 1530650 T4099 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1530650 T4099 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1530651 T4099 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1530652 T4148 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@52562b name:ZooKeeperConnection Watcher:127.0.0.1:47741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1530653 T4099 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1530653 T4099 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1530655 T4099 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1530656 T4150 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@a1f60e name:ZooKeeperConnection Watcher:127.0.0.1:47741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1530656 T4099 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1530662 T4099 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1531665 T4099 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51844_nm_uc
   [junit4]   2> 1531667 T4099 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51844_nm_uc
   [junit4]   2> 1531671 T4099 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1531677 T4152 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1531678 T4152 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1531679 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1531680 T4152 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 1531680 T4152 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 1531681 T4152 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 1531682 T4122 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51844/nm_uc",
   [junit4]   2> 	  "node_name":"127.0.0.1:51844_nm_uc",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1531683 T4152 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0 
   [junit4]   2> 1531683 T4152 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1531686 T4122 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1531687 T4122 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1531692 T4122 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1531693 T4151 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1531693 T4151 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1 
   [junit4]   2> 1532684 T4152 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1532684 T4152 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1532684 T4152 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1532685 T4152 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1532686 T4152 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1532686 T4152 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-003/collection1/'
   [junit4]   2> 1532686 T4152 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 1532686 T4152 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 1532687 T4152 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 1532707 T4152 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1532722 T4152 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1532722 T4152 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1532727 T4152 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1532813 T4152 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1532816 T4152 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1532817 T4152 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1532825 T4152 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1532826 T4152 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1532827 T4152 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1532828 T4152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1532829 T4152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1532829 T4152 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1532830 T4152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1532830 T4152 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1532830 T4152 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1532830 T4152 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1532831 T4152 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/jetty1/
   [junit4]   2> 1532831 T4152 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@156f0f2
   [junit4]   2> 1532831 T4152 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/jetty1
   [junit4]   2> 1532831 T4152 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/jetty1/index/
   [junit4]   2> 1532832 T4152 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 1532832 T4152 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/jetty1/index
   [junit4]   2> 1532832 T4152 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=13.125, floorSegmentMB=1.197265625, forceMergeDeletesPctAllowed=7.335144323560813, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5195369018411685
   [junit4]   2> 1532833 T4152 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-1bafc29)),segFN=segments_1,generation=1}
   [junit4]   2> 1532833 T4152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1532836 T4152 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1532836 T4152 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1532836 T4152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1532836 T4152 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1532837 T4152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1532837 T4152 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1532837 T4152 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1532837 T4152 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1532838 T4152 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1532838 T4152 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1532841 T4152 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1532842 T4152 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1532842 T4152 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1532842 T4152 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1532843 T4152 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1532843 T4152 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1532843 T4152 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1532843 T4152 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1532844 T4152 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1532844 T4152 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1532845 T4152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1532846 T4152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1532846 T4152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1532847 T4152 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1532848 T4152 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1532848 T4152 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1532849 T4152 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=32.349609375, floorSegmentMB=2.0556640625, forceMergeDeletesPctAllowed=24.71840644636208, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.723183819425404
   [junit4]   2> 1532849 T4152 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-1bafc29)),segFN=segments_1,generation=1}
   [junit4]   2> 1532849 T4152 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1532849 T4152 oass.SolrIndexSearcher.<init> Opening Searcher@1439054[collection1] main
   [junit4]   2> 1532850 T4152 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1532850 T4152 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1532851 T4152 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1532851 T4152 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1532851 T4152 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1532851 T4152 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1532852 T4152 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1532852 T4152 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1532852 T4152 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1532853 T4152 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1532854 T4153 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1439054[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1532856 T4152 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1532856 T4156 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:51844/nm_uc collection:collection1 shard:shard2
   [junit4]   2> 1532857 T4099 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1532857 T4156 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1532857 T4099 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1532861 T4156 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1532862 T4156 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1532862 T4156 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C4357 name=collection1 org.apache.solr.core.SolrCore@7dc875 url=http://127.0.0.1:51844/nm_uc/collection1 node=127.0.0.1:51844_nm_uc C4357_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:51844/nm_uc, node_name=127.0.0.1:51844_nm_uc, state=down}
   [junit4]   2> 1532862 T4156 C4357 P51844 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:51844/nm_uc/collection1/
   [junit4]   2> 1532863 T4156 C4357 P51844 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1532863 T4156 C4357 P51844 oasc.SyncStrategy.syncToMe http://127.0.0.1:51844/nm_uc/collection1/ has no replicas
   [junit4]   2> 1532863 T4156 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:51844/nm_uc/collection1/ shard2
   [junit4]   2> 1532863 T4156 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1532864 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1532868 T4122 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1532869 T4151 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1532869 T4151 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2 
   [junit4]   2> 1532879 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1532879 T4122 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1532879 T4151 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1532880 T4151 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 1532917 T4156 oasc.ZkController.register We are http://127.0.0.1:51844/nm_uc/collection1/ and leader is http://127.0.0.1:51844/nm_uc/collection1/
   [junit4]   2> 1532917 T4156 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:51844/nm_uc
   [junit4]   2> 1532917 T4156 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1532917 T4156 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1532917 T4156 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1532918 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1532920 T4156 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 1532920 T4122 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:51844/nm_uc",
   [junit4]   2> 	  "node_name":"127.0.0.1:51844_nm_uc",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1532922 T4122 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1532923 T4151 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1532923 T4151 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 1533105 T4099 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1533106 T4099 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1533107 T4099 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:32973
   [junit4]   2> 1533108 T4099 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1533109 T4099 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1533109 T4099 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-004
   [junit4]   2> 1533109 T4099 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-004/'
   [junit4]   2> 1533119 T4099 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-004/solr.xml
   [junit4]   2> 1533125 T4099 oasc.CoreContainer.<init> New CoreContainer 24755784
   [junit4]   2> 1533125 T4099 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-004/]
   [junit4]   2> 1533126 T4099 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1533126 T4099 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1533126 T4099 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1533127 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1533127 T4099 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1533127 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1533127 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1533128 T4099 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1533128 T4099 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1533128 T4099 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1533129 T4099 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1533129 T4099 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1533129 T4099 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1533129 T4099 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:47741/solr
   [junit4]   2> 1533130 T4099 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1533130 T4099 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1533131 T4099 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1533131 T4168 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@16493e9 name:ZooKeeperConnection Watcher:127.0.0.1:47741 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1533132 T4099 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1533132 T4099 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1533134 T4099 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1533134 T4170 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f1e78 name:ZooKeeperConnection Watcher:127.0.0.1:47741/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1533134 T4099 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1533137 T4099 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1534141 T4099 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39061_nm_uc
   [junit4]   2> 1534142 T4099 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39061_nm_uc
   [junit4]   2> 1534148 T4099 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1534156 T4172 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1534156 T4172 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1534158 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1534159 T4172 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 1534160 T4172 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 1534160 T4172 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 1534162 T4122 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:39061/nm_uc",
   [junit4]   2> 	  "node_name":"127.0.0.1:39061_nm_uc",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1534162 T4172 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 1534163 T4172 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1534166 T4122 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1534167 T4122 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1534173 T4122 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1534174 T4151 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1534174 T4171 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1534175 T4151 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 1534175 T4171 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 1535163 T4172 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1535164 T4172 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1535164 T4172 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1535165 T4172 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1535166 T4172 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1535166 T4172 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-004/collection1/'
   [junit4]   2> 1535167 T4172 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 1535168 T4172 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 1535168 T4172 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 1535205 T4172 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1535214 T4172 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1535215 T4172 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1535219 T4172 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1535307 T4172 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1535311 T4172 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1535312 T4172 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1535321 T4172 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1535322 T4172 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1535324 T4172 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1535324 T4172 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1535325 T4172 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1535326 T4172 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1535326 T4172 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1535327 T4172 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1535327 T4172 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1535327 T4172 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1535327 T4172 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/jetty2/
   [junit4]   2> 1535328 T4172 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@156f0f2
   [junit4]   2> 1535328 T4172 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/jetty2
   [junit4]   2> 1535328 T4172 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/jetty2/index/
   [junit4]   2> 1535328 T4172 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 1535329 T4172 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-001/jetty2/index
   [junit4]   2> 1535329 T4172 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=32, maxMergeAtOnceExplicit=27, maxMergedSegmentMB=13.125, floorSegmentMB=1.197265625, forceMergeDeletesPctAllowed=7.335144323560813, segmentsPerTier=17.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5195369018411685
   [junit4]   2> 1535329 T4172 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-584af7)),segFN=segments_1,generation=1}
   [junit4]   2> 1535330 T4172 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1535332 T4172 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1535332 T4172 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1535332 T4172 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1535333 T4172 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1535333 T4172 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1535333 T4172 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1535333 T4172 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1535333 T4172 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1535334 T4172 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1535334 T4172 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1535334 T4172 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1535335 T4172 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1535335 T4172 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1535335 T4172 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1535335 T4172 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1535336 T4172 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1535336 T4172 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1535336 T4172 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1535337 T4172 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1535337 T4172 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1535339 T4172 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1535339 T4172 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1535340 T4172 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1535341 T4172 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1535342 T4172 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1535342 T4172 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1535342 T4172 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=39, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=32.349609375, floorSegmentMB=2.0556640625, forceMergeDeletesPctAllowed=24.71840644636208, segmentsPerTier=11.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.723183819425404
   [junit4]   2> 1535343 T4172 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-584af7)),segFN=segments_1,generation=1}
   [junit4]   2> 1535343 T4172 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1535343 T4172 oass.SolrIndexSearcher.<init> Opening Searcher@4165d[collection1] main
   [junit4]   2> 1535343 T4172 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1535344 T4172 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1535344 T4172 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1535345 T4172 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1535345 T4172 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1535345 T4172 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1535346 T4172 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1535346 T4172 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1535346 T4172 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1535346 T4172 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1535348 T4173 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4165d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1535350 T4172 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1535350 T4176 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39061/nm_uc collection:collection1 shard:shard1
   [junit4]   2> 1535351 T4099 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1535351 T4099 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1535351 T4176 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 1535355 T4176 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1535356 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1535356 T4176 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1535356 T4176 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C4358 name=collection1 org.apache.solr.core.SolrCore@3d9a9d url=http://127.0.0.1:39061/nm_uc/collection1 node=127.0.0.1:39061_nm_uc C4358_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=http://127.0.0.1:39061/nm_uc, node_name=127.0.0.1:39061_nm_uc, state=down}
   [junit4]   2> 1535356 T4176 C4358 P39061 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39061/nm_uc/collection1/
   [junit4]   2> 1535356 T4176 C4358 P39061 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1535357 T4176 C4358 P39061 oasc.SyncStrategy.syncToMe http://127.0.0.1:39061/nm_uc/collection1/ has no replicas
   [junit4]   2> 1535357 T4176 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39061/nm_uc/collection1/ shard1
   [junit4]   2> 1535357 T4176 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 1535359 T4122 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1535359 T4151 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1535359 T4151 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6 
   [junit4]   2> 1535366 T4171 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1535366 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1535366 T4171 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 6 
   [junit4]   2> 1535369 T4122 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1535369 T4151 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1535369 T4171 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1535370 T4151 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7 
   [junit4]   2> 1535370 T4171 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7 
   [junit4]   2> 1535417 T4176 oasc.ZkController.register We are http://127.0.0.1:39061/nm_uc/collection1/ and leader is http://127.0.0.1:39061/nm_uc/collection1/
   [junit4]   2> 1535417 T4176 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39061/nm_uc
   [junit4]   2> 1535417 T4176 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1535417 T4176 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1535418 T4176 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1535419 T4126 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1535420 T4176 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 7 
   [junit4]   2> 1535420 T4122 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node2",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"http://127.0.0.1:39061/nm_uc",
   [junit4]   2> 	  "node_name":"127.0.0.1:39061_nm_uc",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1535423 T4122 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1535423 T4151 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1535423 T4171 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1535423 T4151 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 8 
   [junit4]   2> 1535424 T4171 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 8 
   [junit4]   2> 1535605 T4099 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 1535605 T4099 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1535607 T4099 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54932
   [junit4]   2> 1535608 T4099 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1535608 T4099 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1535608 T4099 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-005
   [junit4]   2> 1535609 T4099 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-005/'
   [junit4]   2> 1535618 T4099 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-005/solr.xml
   [junit4]   2> 1535641 T4099 oasc.CoreContainer.<init> New CoreContainer 19437711
   [junit4]   2> 1535642 T4099 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001/tempDir-005/]
   [junit4]   2> 1535642 T4099 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1535643 T4099 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1535643 T4099 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1535643 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1535644 T4099 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1535644 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1535644 T4099 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1535645 T4099 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1535645 T4099 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1535646 T4099 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1535646 T4099 oasl.LogWatcher.createWatcher SLF4J impl 

[...truncated too long message...]

va:520)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.updateClusterState(ZkStateReader.java:253)
   [junit4]   2> 	at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:277)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.InterruptedException
   [junit4]   2> 	at java.lang.Object.wait(Native Method)
   [junit4]   2> 	at java.lang.Object.wait(Object.java:502)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1342)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1153)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:347)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:344)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:344)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getCollectionLive(ZkStateReader.java:761)
   [junit4]   2> 	... 4 more
   [junit4]   2> 
   [junit4]   2> 1630989 T4455 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:37774_nm_uc
   [junit4]   2> 1630989 T4418 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1630989 T4191 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 1631017 T4099 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/nm_uc,null}
   [junit4]   2> 1636005 T4099 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 1636007 T4099 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:47741 47741
   [junit4]   2> 1636554 T4100 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:47741 47741
   [junit4]   2> 1636556 T4100 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations: 
   [junit4]   2> 	Maximum concurrent create/delete watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		6	/solr/aliases.json
   [junit4]   2> 		6	/solr/clusterstate.json
   [junit4]   2> 		4	/solr/collections/collection1/state.json
   [junit4]   2> 		3	/solr/collections/c8n_1x3/state.json
   [junit4]   2> 		3	/solr/collections/c8n_1x2_leader_session_loss/state.json
   [junit4]   2> 		2	/solr/collections/c8n_1x2/state.json
   [junit4]   2> 	
   [junit4]   2> 	Maximum concurrent data watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		2	/solr/overseer_elect/election/92535479001481225-127.0.0.1:39061_nm_uc-n_0000000002
   [junit4]   2> 		2	/solr/collections/collection1/leader_elect/shard2/election/92535479001481223-core_node1-n_0000000000
   [junit4]   2> 	
   [junit4]   2> 	Maximum concurrent children watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		7	/solr/live_nodes
   [junit4]   2> 		4	/solr/overseer/queue
   [junit4]   2> 		4	/solr/overseer/collection-queue-work
   [junit4]   2> 	
   [junit4]   2> 1636556 T4099 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:51489/nm_uc
   [junit4]   2> 1636557 T4099 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:39061/nm_uc
   [junit4]   2> 1636558 T4099 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:37774/nm_uc
   [junit4]   2> 1636558 T4099 oasc.SocketProxy.close WARN Closing 0 connections to: http://127.0.0.1:51844/nm_uc
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpPartitionTest -Dtests.method=testDistribSearch -Dtests.seed=FC05035FA51DFD06 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=cs_CZ -Dtests.timezone=Chile/EasterIsland -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE  108s J1 | HttpPartitionTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Doc with id=2 not found in http://127.0.0.1:37774/nm_uc/c8n_1x2_leader_session_loss due to: Path not found: /id; rsp={doc=null}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FC05035FA51DFD06:7DE38D47D2429D3A]:0)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:437)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.testLeaderZkSessionLoss(HttpPartitionTest.java:324)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.doTest(HttpPartitionTest.java:119)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1636574 T4099 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.HttpPartitionTest-FC05035FA51DFD06-001
   [junit4]   2> 107942 T4098 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {_version_=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), multiDefault=PostingsFormat(name=Asserting), a_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), intDefault=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), id=PostingsFormat(name=Memory doPackFST= true), text=FSTOrd41, range_facet_l=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128))), timestamp=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene41(blocksize=128)))}, docValues:{timestamp=DocValuesFormat(name=SimpleText)}, sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=cs_CZ, timezone=Chile/EasterIsland
   [junit4]   2> NOTE: Linux 3.13.0-36-generic i386/Oracle Corporation 1.9.0-ea (32-bit)/cpus=8,threads=1,free=157439888,total=395538432
   [junit4]   2> NOTE: All tests run in this JVM: [StatsComponentTest, DateFieldTest, TestJoin, LoggingHandlerTest, DeleteInactiveReplicaTest, TestManagedResourceStorage, RAMDirectoryFactoryTest, TestSolr4Spatial2, TestCloudSchemaless, TermVectorComponentTest, TestFieldSortValues, URLClassifyProcessorTest, TestPivotHelperCode, SolrXmlInZkTest, ChaosMonkeySafeLeaderTest, TestLazyCores, TestWriterPerf, ParsingFieldUpdateProcessorsTest, DeleteShardTest, TestMultiCoreConfBootstrap, TestAnalyzeInfixSuggestions, DistanceFunctionTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestElisionMultitermQuery, OverriddenZkACLAndCredentialsProvidersTest, TestOmitPositions, IndexSchemaRuntimeFieldTest, AnalyticsMergeStrategyTest, HardAutoCommitTest, SortByFunctionTest, TestNRTOpen, FileBasedSpellCheckerTest, TestAddFieldRealTimeGet, TestCloudManagedSchemaConcurrent, TestInitQParser, BlockDirectoryTest, TestUtils, CircularListTest, CoreAdminCreateDiscoverTest, PrimUtilsTest, DocValuesTest, TestPerFieldSimilarity, TestCollectionAPI, TestJmxMonitoredMap, TestExtendedDismaxParser, SolrCoreTest, TestSearcherReuse, TestCSVResponseWriter, FullSolrCloudDistribCmdsTest, PreAnalyzedFieldTest, BasicDistributedZk2Test, SpatialFilterTest, CoreAdminRequestStatusTest, TestIndexingPerformance, TestRecovery, TestSchemaNameResource, TestSolrQueryParser, ReplicationFactorTest, TestStressLucene, ClusterStateTest, TestQueryTypes, TestPHPSerializedResponseWriter, TestBinaryField, TestStandardQParsers, MergeStrategyTest, TestSolrXml, DirectSolrConnectionTest, SchemaVersionSpecificBehaviorTest, DistributedQueryElevationComponentTest, TestChildDocTransformer, DistributedTermsComponentTest, TestImplicitCoreProperties, ExitableDirectoryReaderTest, LeaderFailoverAfterPartitionTest, TestFunctionQuery, FieldAnalysisRequestHandlerTest, UpdateRequestProcessorFactoryTest, SolrInfoMBeanTest, TestHighFrequencyDictionaryFactory, SharedFSAutoReplicaFailoverUtilsTest, DistributedIntervalFacetingTest, QueryParsingTest, HdfsLockFactoryTest, OpenCloseCoreStressTest, TestCollationField, LukeRequestHandlerTest, DistributedQueryComponentOptimizationTest, BJQParserTest, TestReplicationHandlerBackup, SuggestComponentTest, TestCloudManagedSchema, TestManagedSchemaDynamicFieldResource, CSVRequestHandlerTest, BinaryUpdateRequestHandlerTest, TestDefaultSearchFieldResource, TestHighlightDedupGrouping, TestDistributedGrouping, AliasIntegrationTest, CopyFieldTest, SolrTestCaseJ4Test, BasicZkTest, DateMathParserTest, CoreMergeIndexesAdminHandlerTest, HttpPartitionTest]
   [junit4] Completed on J1 in 108.23s, 1 test, 1 failure <<< FAILURES!

[...truncated 674 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:524: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:472: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1359: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:961: There were test failures: 432 suites, 1778 tests, 1 failure, 44 ignored (22 assumptions)

Total time: 98 minutes 8 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.9.0-ea-b28 -server -XX:+UseConcMarkSweepGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.9.0-ea-b28) - Build # 11350 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11350/
Java: 64bit/jdk1.9.0-ea-b28 -XX:+UseCompressedOops -XX:+UseParallelGC

3 tests failed.
REGRESSION:  org.apache.solr.cloud.DeleteReplicaTest.testDistribSearch

Error Message:
No live SolrServers available to handle this request:[http://127.0.0.1:47512/vqqpo, http://127.0.0.1:59264/vqqpo, http://127.0.0.1:59549/vqqpo, http://127.0.0.1:46014/vqqpo, http://127.0.0.1:56419/vqqpo]

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: No live SolrServers available to handle this request:[http://127.0.0.1:47512/vqqpo, http://127.0.0.1:59264/vqqpo, http://127.0.0.1:59549/vqqpo, http://127.0.0.1:46014/vqqpo, http://127.0.0.1:56419/vqqpo]
	at __randomizedtesting.SeedInfo.seed([48532332BF07798A:C9B5AD2AC85819B6]:0)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:322)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.sendRequest(CloudSolrServer.java:880)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.requestWithRetryOnStaleState(CloudSolrServer.java:658)
	at org.apache.solr.client.solrj.impl.CloudSolrServer.request(CloudSolrServer.java:601)
	at org.apache.solr.cloud.DeleteReplicaTest.removeAndWaitForReplicaGone(DeleteReplicaTest.java:171)
	at org.apache.solr.cloud.DeleteReplicaTest.deleteLiveReplicaTest(DeleteReplicaTest.java:144)
	at org.apache.solr.cloud.DeleteReplicaTest.doTest(DeleteReplicaTest.java:88)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.GeneratedMethodAccessor39.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:484)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrServer$RemoteSolrException: Could not  remove replica : delLiveColl/shard1/core_node1
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:570)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.doRequest(LBHttpSolrServer.java:343)
	at org.apache.solr.client.solrj.impl.LBHttpSolrServer.request(LBHttpSolrServer.java:304)
	... 46 more


REGRESSION:  org.apache.solr.core.ExitableDirectoryReaderTest.testPrefixQuery

Error Message:


Stack Trace:
java.lang.AssertionError: 
	at __randomizedtesting.SeedInfo.seed([48532332BF07798A:FB041770DBDA9D0F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.SolrTestCaseJ4.assertQEx(SolrTestCaseJ4.java:850)
	at org.apache.solr.core.ExitableDirectoryReaderTest.testPrefixQuery(ExitableDirectoryReaderTest.java:61)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:484)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  org.apache.solr.cloud.CloudExitableDirectoryReaderTest.testDistribSearch

Error Message:
no exception matching expected: 400: Request took too long during query expansion. Terminating request.

Stack Trace:
java.lang.AssertionError: no exception matching expected: 400: Request took too long during query expansion. Terminating request.
	at __randomizedtesting.SeedInfo.seed([48532332BF07798A:C9B5AD2AC85819B6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.assertFail(CloudExitableDirectoryReaderTest.java:101)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTimeoutTests(CloudExitableDirectoryReaderTest.java:81)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTest(CloudExitableDirectoryReaderTest.java:54)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:484)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11329 lines...]
   [junit4] Suite: org.apache.solr.cloud.CloudExitableDirectoryReaderTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/init-core-data-001
   [junit4]   2> 1033140 T2886 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (true)
   [junit4]   2> 1033140 T2886 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 1033143 T2886 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 1033144 T2886 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1033145 T2887 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 1033244 T2886 oasc.ZkTestServer.run start zk server on port:49267
   [junit4]   2> 1033245 T2886 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1033246 T2886 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1033249 T2893 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7f807faa name:ZooKeeperConnection Watcher:127.0.0.1:49267 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1033249 T2886 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1033250 T2886 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1033250 T2886 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 1033253 T2886 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1033258 T2886 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1033259 T2895 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@6d00f7b1 name:ZooKeeperConnection Watcher:127.0.0.1:49267/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1033259 T2886 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1033260 T2886 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1033260 T2886 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 1033262 T2886 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 1033264 T2886 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 1033264 T2886 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 1033266 T2886 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1033266 T2886 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1033268 T2886 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1033268 T2886 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 1033270 T2886 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1033270 T2886 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1033272 T2886 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1033272 T2886 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1033273 T2886 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1033274 T2886 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1033283 T2886 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1033284 T2886 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 1033285 T2886 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1033285 T2886 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1033286 T2886 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1033287 T2886 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1033288 T2886 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1033288 T2886 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1033289 T2886 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1033289 T2886 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1033290 T2886 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1033291 T2886 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1033292 T2886 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1033295 T2886 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1033302 T2897 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@202ebc20 name:ZooKeeperConnection Watcher:127.0.0.1:49267/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1033303 T2886 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1033303 T2886 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1033575 T2886 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1033577 T2886 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1033592 T2886 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:34510
   [junit4]   2> 1033593 T2886 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1033593 T2886 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1033594 T2886 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-002
   [junit4]   2> 1033594 T2886 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-002/'
   [junit4]   2> 1033604 T2886 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-002/solr.xml
   [junit4]   2> 1033613 T2886 oasc.CoreContainer.<init> New CoreContainer 1641391552
   [junit4]   2> 1033614 T2886 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-002/]
   [junit4]   2> 1033614 T2886 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1033614 T2886 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1033615 T2886 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1033615 T2886 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1033615 T2886 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1033615 T2886 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1033615 T2886 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1033615 T2886 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1033616 T2886 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1033617 T2886 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1033617 T2886 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1033618 T2886 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1033618 T2886 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1033618 T2886 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49267/solr
   [junit4]   2> 1033618 T2886 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1033619 T2886 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1033619 T2886 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1033624 T2908 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@70a91049 name:ZooKeeperConnection Watcher:127.0.0.1:49267 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1033624 T2886 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1033625 T2886 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1033631 T2886 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1033632 T2910 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@54b1e127 name:ZooKeeperConnection Watcher:127.0.0.1:49267/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1033632 T2886 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1033634 T2886 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 1033635 T2886 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 1033637 T2886 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 1033638 T2886 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 1033639 T2886 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 1033641 T2886 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 1033642 T2886 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34510_
   [junit4]   2> 1033642 T2886 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:34510_
   [junit4]   2> 1033644 T2886 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 1033645 T2886 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 1033646 T2886 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1033647 T2886 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:34510_
   [junit4]   2> 1033647 T2886 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 1033648 T2886 oasc.Overseer.start Overseer (id=92537289700737028-127.0.0.1:34510_-n_0000000000) starting
   [junit4]   2> 1033649 T2886 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 1033653 T2886 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1033654 T2912 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 1033655 T2911 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 1033655 T2886 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 1033657 T2886 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 1033658 T2886 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1033661 T2914 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 1033663 T2914 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1033665 T2914 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1033665 T2915 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1033667 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:34510",
   [junit4]   2> 	  "node_name":"127.0.0.1:34510_",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1033667 T2911 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 1033667 T2911 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1
   [junit4]   2> 1033667 T2911 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1033683 T2915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1034665 T2914 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1034666 T2914 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 1034666 T2914 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1034666 T2914 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1034666 T2914 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1034667 T2914 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-002/collection1/'
   [junit4]   2> 1034667 T2914 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 1034667 T2914 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 1034667 T2914 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 1034683 T2914 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1034706 T2914 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1034707 T2914 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1034710 T2914 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1034779 T2914 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1034783 T2914 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1034784 T2914 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1034789 T2914 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1034791 T2914 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1034792 T2914 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1034793 T2914 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1034793 T2914 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1034794 T2914 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1034794 T2914 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1034794 T2914 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1034794 T2914 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1034795 T2914 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1034795 T2914 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/control/data/
   [junit4]   2> 1034795 T2914 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f48baf
   [junit4]   2> 1034795 T2914 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/control/data
   [junit4]   2> 1034795 T2914 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/control/data/index/
   [junit4]   2> 1034795 T2914 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1034796 T2914 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/control/data/index
   [junit4]   2> 1034796 T2914 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1034796 T2914 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-4ba416f7)),segFN=segments_1,generation=1}
   [junit4]   2> 1034796 T2914 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1034798 T2914 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1034798 T2914 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1034798 T2914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1034798 T2914 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1034798 T2914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1034799 T2914 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1034799 T2914 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1034799 T2914 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1034799 T2914 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1034800 T2914 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1034800 T2914 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1034800 T2914 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1034800 T2914 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1034800 T2914 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1034800 T2914 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1034801 T2914 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1034801 T2914 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1034801 T2914 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1034801 T2914 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1034801 T2914 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1034803 T2914 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1034803 T2914 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1034804 T2914 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1034804 T2914 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1034805 T2914 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1034805 T2914 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1034806 T2914 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=82.064453125, floorSegmentMB=2.1884765625, forceMergeDeletesPctAllowed=17.518579599039594, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34514987743752135
   [junit4]   2> 1034806 T2914 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-4ba416f7)),segFN=segments_1,generation=1}
   [junit4]   2> 1034806 T2914 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1034806 T2914 oass.SolrIndexSearcher.<init> Opening Searcher@709ab28d[collection1] main
   [junit4]   2> 1034806 T2914 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 1034807 T2914 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1034807 T2914 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1034807 T2914 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1034807 T2914 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1034808 T2914 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1034808 T2914 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1034808 T2914 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1034808 T2914 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 1034809 T2914 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1034810 T2914 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1034810 T2914 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1034811 T2916 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@709ab28d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1034811 T2914 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1034812 T2919 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:34510 collection:control_collection shard:shard1
   [junit4]   2> 1034812 T2886 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1034812 T2919 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1034812 T2886 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1034814 T2886 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1034815 T2919 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 1034815 T2886 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1034816 T2921 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4146c5a6 name:ZooKeeperConnection Watcher:127.0.0.1:49267/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1034817 T2886 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1034817 T2886 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1034818 T2886 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1034819 T2915 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1034819 T2919 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1034819 T2919 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1016 name=collection1 org.apache.solr.core.SolrCore@74485d5f url=https://127.0.0.1:34510/collection1 node=127.0.0.1:34510_ C1016_STATE=coll:control_collection core:collection1 props:{core=collection1, base_url=https://127.0.0.1:34510, node_name=127.0.0.1:34510_, state=down}
   [junit4]   2> 1034819 T2919 C1016 P34510 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:34510/collection1/
   [junit4]   2> 1034820 T2919 C1016 P34510 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1034820 T2886 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1034820 T2919 C1016 P34510 oasc.SyncStrategy.syncToMe https://127.0.0.1:34510/collection1/ has no replicas
   [junit4]   2> 1034820 T2919 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:34510/collection1/ shard1
   [junit4]   2> 1034820 T2886 oasc.AbstractFullDistribZkTestBase.createJettys Creating collection1 with stateFormat=2
   [junit4]   2> 1034820 T2919 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1034820 T2886 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1034821 T2886 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1034826 T2923 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4925023 name:ZooKeeperConnection Watcher:127.0.0.1:49267/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1034826 T2886 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1034826 T2886 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1034831 T2915 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1034833 T2911 oasc.Overseer$ClusterStateUpdater.buildCollection building a new collection: collection1
   [junit4]   2> 1034834 T2911 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 1034834 T2911 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 2
   [junit4]   2> 1034835 T2915 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1034835 T2911 oasc.Overseer$ClusterStateUpdater.updateZkStates going to create_collection /collections/collection1/state.json
   [junit4]   2> 1034836 T2915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1034837 T2924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1034890 T2919 oasc.ZkController.register We are https://127.0.0.1:34510/collection1/ and leader is https://127.0.0.1:34510/collection1/
   [junit4]   2> 1034890 T2919 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:34510
   [junit4]   2> 1034891 T2919 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1034891 T2919 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 1034891 T2919 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1034899 T2915 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1034902 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:34510",
   [junit4]   2> 	  "node_name":"127.0.0.1:34510_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1035004 T2924 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1035004 T2915 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1035159 T2886 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 1035160 T2886 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1035162 T2886 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1035164 T2886 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:36325
   [junit4]   2> 1035166 T2886 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1035166 T2886 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1035166 T2886 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-003
   [junit4]   2> 1035167 T2886 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-003/'
   [junit4]   2> 1035184 T2886 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-003/solr.xml
   [junit4]   2> 1035193 T2886 oasc.CoreContainer.<init> New CoreContainer 426468420
   [junit4]   2> 1035193 T2886 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-003/]
   [junit4]   2> 1035194 T2886 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1035194 T2886 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1035195 T2886 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1035195 T2886 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1035195 T2886 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1035195 T2886 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1035196 T2886 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1035196 T2886 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1035196 T2886 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1035198 T2886 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1035199 T2886 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1035199 T2886 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1035200 T2886 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1035200 T2886 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49267/solr
   [junit4]   2> 1035200 T2886 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1035201 T2886 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1035201 T2886 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1035207 T2935 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@46b78e8d name:ZooKeeperConnection Watcher:127.0.0.1:49267 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1035208 T2886 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1035209 T2886 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1035211 T2886 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1035213 T2937 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2057d934 name:ZooKeeperConnection Watcher:127.0.0.1:49267/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1035213 T2886 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1035217 T2886 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1036220 T2886 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36325_
   [junit4]   2> 1036221 T2886 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36325_
   [junit4]   2> 1036224 T2886 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1036228 T2939 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1036228 T2939 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1036229 T2915 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1036229 T2939 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 1036229 T2939 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 1036230 T2939 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 1036230 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:36325",
   [junit4]   2> 	  "node_name":"127.0.0.1:36325_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1036230 T2939 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 0 
   [junit4]   2> 1036231 T2939 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1036232 T2911 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1036232 T2911 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 1036234 T2911 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1036235 T2938 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1036235 T2938 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 1 
   [junit4]   2> 1037231 T2939 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1037231 T2939 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1037232 T2939 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1037232 T2939 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1037233 T2939 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1037233 T2939 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-003/collection1/'
   [junit4]   2> 1037233 T2939 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 1037233 T2939 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 1037234 T2939 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 1037249 T2939 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1037257 T2939 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1037258 T2939 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1037261 T2939 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1037340 T2939 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1037343 T2939 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1037344 T2939 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1037349 T2939 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1037351 T2939 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1037352 T2939 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1037353 T2939 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1037354 T2939 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1037354 T2939 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1037355 T2939 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1037355 T2939 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1037355 T2939 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1037355 T2939 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1037355 T2939 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/jetty1/
   [junit4]   2> 1037355 T2939 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f48baf
   [junit4]   2> 1037356 T2939 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/jetty1
   [junit4]   2> 1037356 T2939 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/jetty1/index/
   [junit4]   2> 1037356 T2939 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 1037356 T2939 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/jetty1/index
   [junit4]   2> 1037356 T2939 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1037357 T2939 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-159af10a)),segFN=segments_1,generation=1}
   [junit4]   2> 1037357 T2939 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1037359 T2939 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1037359 T2939 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1037359 T2939 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1037359 T2939 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1037359 T2939 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1037359 T2939 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1037360 T2939 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1037360 T2939 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1037360 T2939 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1037360 T2939 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1037360 T2939 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1037361 T2939 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1037361 T2939 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1037361 T2939 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1037361 T2939 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1037361 T2939 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1037362 T2939 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 1037362 T2939 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 1037362 T2939 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 1037362 T2939 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 1037364 T2939 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1037364 T2939 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1037365 T2939 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1037365 T2939 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 1037366 T2939 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 1037366 T2939 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 1037367 T2939 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=24, maxMergedSegmentMB=82.064453125, floorSegmentMB=2.1884765625, forceMergeDeletesPctAllowed=17.518579599039594, segmentsPerTier=15.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.34514987743752135
   [junit4]   2> 1037367 T2939 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-159af10a)),segFN=segments_1,generation=1}
   [junit4]   2> 1037367 T2939 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1037367 T2939 oass.SolrIndexSearcher.<init> Opening Searcher@4ddbea43[collection1] main
   [junit4]   2> 1037367 T2939 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1037368 T2939 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1037369 T2939 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1037369 T2939 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1037369 T2939 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 1037369 T2939 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1037370 T2939 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1037370 T2939 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1037370 T2939 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 1037370 T2939 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 1037371 T2940 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@4ddbea43[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1037373 T2939 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 1037373 T2943 oasc.ZkController.register Register replica - core:collection1 address:https://127.0.0.1:36325 collection:collection1 shard:shard2
   [junit4]   2> 1037374 T2886 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 1037374 T2943 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 1037374 T2886 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 1037376 T2943 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 1037377 T2915 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1037377 T2943 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 1037378 T2943 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C1017 name=collection1 org.apache.solr.core.SolrCore@1dff6538 url=https://127.0.0.1:36325/collection1 node=127.0.0.1:36325_ C1017_STATE=coll:collection1 core:collection1 props:{core=collection1, base_url=https://127.0.0.1:36325, node_name=127.0.0.1:36325_, state=down}
   [junit4]   2> 1037378 T2943 C1017 P36325 oasc.SyncStrategy.sync Sync replicas to https://127.0.0.1:36325/collection1/
   [junit4]   2> 1037378 T2943 C1017 P36325 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 1037378 T2943 C1017 P36325 oasc.SyncStrategy.syncToMe https://127.0.0.1:36325/collection1/ has no replicas
   [junit4]   2> 1037378 T2943 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: https://127.0.0.1:36325/collection1/ shard2
   [junit4]   2> 1037378 T2943 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 1037380 T2911 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1037380 T2938 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1037381 T2938 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 2 
   [junit4]   2> 1037383 T2915 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1037383 T2911 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1037384 T2938 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1037384 T2938 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 1037431 T2943 oasc.ZkController.register We are https://127.0.0.1:36325/collection1/ and leader is https://127.0.0.1:36325/collection1/
   [junit4]   2> 1037431 T2943 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:36325
   [junit4]   2> 1037431 T2943 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 1037432 T2943 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 1037432 T2943 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1037433 T2915 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1037434 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:36325",
   [junit4]   2> 	  "node_name":"127.0.0.1:36325_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1037435 T2943 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 3 
   [junit4]   2> 1037437 T2911 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1037437 T2938 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1037438 T2938 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 1037598 T2886 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 1037599 T2886 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 1037602 T2886 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 1037603 T2886 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:51015
   [junit4]   2> 1037605 T2886 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 1037605 T2886 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1037605 T2886 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-004
   [junit4]   2> 1037605 T2886 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-004/'
   [junit4]   2> 1037614 T2886 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-004/solr.xml
   [junit4]   2> 1037620 T2886 oasc.CoreContainer.<init> New CoreContainer 1513032300
   [junit4]   2> 1037621 T2886 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-004/]
   [junit4]   2> 1037621 T2886 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 1037621 T2886 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 1037621 T2886 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 1037622 T2886 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 1037622 T2886 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 1037622 T2886 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 1037622 T2886 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 1037622 T2886 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 1037623 T2886 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 1037624 T2886 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 1037624 T2886 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1037625 T2886 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1037625 T2886 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 1037625 T2886 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:49267/solr
   [junit4]   2> 1037625 T2886 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 1037625 T2886 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 1037626 T2886 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1037628 T2954 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7c4a98e name:ZooKeeperConnection Watcher:127.0.0.1:49267 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1037629 T2886 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1037629 T2886 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 1037631 T2886 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 1037633 T2956 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3a898a68 name:ZooKeeperConnection Watcher:127.0.0.1:49267/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1037633 T2886 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 1037636 T2886 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 1038639 T2886 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51015_
   [junit4]   2> 1038640 T2886 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:51015_
   [junit4]   2> 1038642 T2886 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 1038646 T2958 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 1038646 T2958 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 1038647 T2915 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 1038648 T2958 oasc.ZkController.preRegister Registering watch for external collection collection1
   [junit4]   2> 1038648 T2958 oascc.ZkStateReader.addZkWatch addZkWatch collection1
   [junit4]   2> 1038648 T2958 oascc.ZkStateReader.addZkWatch Updating collection state at /collections/collection1/state.json from ZooKeeper... 
   [junit4]   2> 1038649 T2911 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "base_url":"https://127.0.0.1:51015",
   [junit4]   2> 	  "node_name":"127.0.0.1:51015_",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "operation":"state"}
   [junit4]   2> 1038649 T2958 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 4 
   [junit4]   2> 1038649 T2958 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 1038650 T2911 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 1038650 T2911 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 1038652 T2911 oasc.Overseer$ClusterStateUpdater.updateZkStates going to update_collection /collections/collection1/state.json
   [junit4]   2> 1038653 T2938 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1038653 T2957 oascc.ZkStateReader$7.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json, has occurred - updating... 
   [junit4]   2> 1038653 T2938 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 1038653 T2957 oascc.ZkStateReader.updateWatchedCollection Updating data for collection1 to ver 5 
   [junit4]   2> 1039649 T2958 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1039650 T2958 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 1039650 T2958 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 1039650 T2958 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 1039651 T2958 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1039651 T2958 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-004/collection1/'
   [junit4]   2> 1039651 T2958 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 1039652 T2958 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 1039652 T2958 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 1039668 T2958 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1039676 T2958 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1039677 T2958 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 1039680 T2958 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 1039757 T2958 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1039760 T2958 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 1039761 T2958 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 1039767 T2958 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1039768 T2958 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 1039769 T2958 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1039770 T2958 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1039771 T2958 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1039771 T2958 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1039771 T2958 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 1039772 T2958 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 1039772 T2958 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1039772 T2958 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1039772 T2958 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/jetty2/
   [junit4]   2> 1039772 T2958 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@2f48baf
   [junit4]   2> 1039773 T2958 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/jetty2
   [junit4]   2> 1039773 T2958 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/jetty2/index/
   [junit4]   2> 1039773 T2958 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 1039773 T2958 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CloudExitableDirectoryReaderTest-48532332BF07798A-001/tempDir-001/jetty2/index
   [junit4]   2> 1039773 T2958 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1039774 T2958 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-71005bba)),segFN=segments_1,generation=1}
   [junit4]   2> 1039774 T2958 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 1039775 T2958 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1039775 T2958 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1039776 T2958 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1039776 T2958 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1039776 T2958 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1039776 T2958 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1039776 T2958 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1039776 T2958 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1039776 T2958 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1039777 T2958 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1039777 T2958 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1039777 T2958 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 1039777 T2958 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 1039778 T2958 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 1039778 T2958 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 1039778 T2958 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 1039778 T2958 oasc.RequestHandlers.initHandlersFromConfig created /updat

[...truncated too long message...]

e:doc*&indent=true&timeAllowed=1} status=400 QTime=3 
   [junit4]   2> 2482566 T7092 oas.SolrTestCaseJ4.tearDown ###Ending testQueriesOnDocsWithMultipleTerms
   [junit4]   2> 2482569 T7092 oas.SolrTestCaseJ4.setUp ###Starting testPrefixQuery
   [junit4]   2> 2482570 T7092 C1192 oasc.SolrCore.execute [collection1] webapp=null path=null params={q=name:a*&indent=true&timeAllowed=1} hits=1999 status=0 QTime=1 
   [junit4]   2> 2482570 T7092 oas.SolrTestCaseJ4.tearDown ###Ending testPrefixQuery
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ExitableDirectoryReaderTest -Dtests.method=testPrefixQuery -Dtests.seed=48532332BF07798A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=zh_HK_#Hant -Dtests.timezone=Asia/Kuala_Lumpur -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.01s J1 | ExitableDirectoryReaderTest.testPrefixQuery <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: 
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([48532332BF07798A:FB041770DBDA9D0F]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.assertQEx(SolrTestCaseJ4.java:850)
   [junit4]    > 	at org.apache.solr.core.ExitableDirectoryReaderTest.testPrefixQuery(ExitableDirectoryReaderTest.java:61)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2482574 T7092 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> 2482574 T7092 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=649285765
   [junit4]   2> 2482574 T7092 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@5c7cd3a4
   [junit4]   2> 2482574 T7092 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=1,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=5997,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2482575 T7092 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 2482575 T7092 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2482575 T7092 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2482575 T7092 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 2482575 T7092 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2482576 T7092 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.ExitableDirectoryReaderTest-48532332BF07798A-001/init-core-data-001 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.ExitableDirectoryReaderTest-48532332BF07798A-001/init-core-data-001;done=false>>]
   [junit4]   2> 2482576 T7092 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.ExitableDirectoryReaderTest-48532332BF07798A-001/init-core-data-001
   [junit4]   2> 2482576 T7092 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.ExitableDirectoryReaderTest-48532332BF07798A-001/init-core-data-001/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.ExitableDirectoryReaderTest-48532332BF07798A-001/init-core-data-001/index;done=false>>]
   [junit4]   2> 2482576 T7092 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.ExitableDirectoryReaderTest-48532332BF07798A-001/init-core-data-001/index
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.core.ExitableDirectoryReaderTest-48532332BF07798A-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {name=PostingsFormat(name=Lucene41VarGapFixedInterval), id=PostingsFormat(name=Lucene41VarGapFixedInterval)}, docValues:{}, sim=DefaultSimilarity, locale=zh_HK_#Hant, timezone=Asia/Kuala_Lumpur
   [junit4]   2> NOTE: Linux 3.13.0-36-generic amd64/Oracle Corporation 1.9.0-ea (64-bit)/cpus=8,threads=1,free=145240976,total=419430400
   [junit4]   2> NOTE: All tests run in this JVM: [UniqFieldsUpdateProcessorFactoryTest, TestIndexSearcher, TestChildDocTransformer, TestHighFrequencyDictionaryFactory, TestFieldCollectionResource, ResponseHeaderTest, TestLeaderElectionZkExpiry, SortByFunctionTest, AnalyticsMergeStrategyTest, TermVectorComponentDistributedTest, SoftAutoCommitTest, VMParamsZkACLAndCredentialsProvidersTest, TestIndexingPerformance, TestFileDictionaryLookup, AddSchemaFieldsUpdateProcessorFactoryTest, LeaderFailoverAfterPartitionTest, AutoCommitTest, TestMaxScoreQueryParser, QueryElevationComponentTest, OpenCloseCoreStressTest, AliasIntegrationTest, TestJmxMonitoredMap, TestValueSourceCache, ScriptEngineTest, TestStandardQParsers, TestManagedResourceStorage, SpatialFilterTest, ReplicationFactorTest, TestShortCircuitedRequests, DeleteInactiveReplicaTest, TestNoOpRegenerator, AddBlockUpdateTest, TestCSVResponseWriter, TestManagedSchemaDynamicFieldResource, TestFieldTypeCollectionResource, TestRealTimeGet, SampleTest, CoreMergeIndexesAdminHandlerTest, TestQuerySenderNoQuery, TestWriterPerf, AssignTest, TestInfoStreamLogging, BlockDirectoryTest, HdfsLockFactoryTest, TestCollationField, SolrInfoMBeanTest, TestDistributedGrouping, TestAtomicUpdateErrorCases, ZkSolrClientTest, TestRandomFaceting, SSLMigrationTest, TestImplicitCoreProperties, TestDistribDocBasedVersion, ShardRoutingCustomTest, TestMergePolicyConfig, CoreAdminRequestStatusTest, SchemaVersionSpecificBehaviorTest, SolrCoreTest, LegacyHTMLStripCharFilterTest, TestLFUCache, CSVRequestHandlerTest, SearchHandlerTest, DocValuesTest, TestGroupingSearch, URLClassifyProcessorTest, TestNRTOpen, TestCopyFieldCollectionResource, TestPerFieldSimilarity, TestSortingResponseWriter, TestSolrXmlPersistor, TestReversedWildcardFilterFactory, TestCSVLoader, FullSolrCloudDistribCmdsTest, TestDynamicFieldCollectionResource, ClusterStateTest, TestIBSimilarityFactory, TestQueryTypes, CopyFieldTest, TestAddFieldRealTimeGet, PreAnalyzedFieldTest, TestCursorMarkWithoutUniqueKey, CacheHeaderTest, CustomCollectionTest, SuggesterFSTTest, SharedFSAutoReplicaFailoverTest, TestFiltering, NumericFieldsTest, DistributedQueryComponentOptimizationTest, SynonymTokenizerTest, RequestHandlersTest, TestCoreContainer, StressHdfsTest, OutputWriterTest, TestPostingsSolrHighlighter, QueryResultKeyTest, SliceStateTest, BasicZkTest, AnalysisAfterCoreReloadTest, TestUpdate, CurrencyFieldXmlFileTest, DistributedQueryElevationComponentTest, HighlighterMaxOffsetTest, TestFunctionQuery, DeleteShardTest, TestCharFilters, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, LeaderElectionIntegrationTest, TestReplicationHandler, SolrCoreCheckLockOnStartupTest, DirectUpdateHandlerOptimizeTest, StatelessScriptUpdateProcessorFactoryTest, DisMaxRequestHandlerTest, TestQueryUtils, DirectSolrSpellCheckerTest, FileBasedSpellCheckerTest, DocumentBuilderTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, SolrPluginUtilsTest, ReturnFieldsTest, JSONWriterTest, QueryParsingTest, BinaryUpdateRequestHandlerTest, PingRequestHandlerTest, TestBinaryResponseWriter, TestQuerySenderListener, AlternateDirectoryTest, SolrIndexConfigTest, TestSolrDeletionPolicy2, TestDocSet, TestElisionMultitermQuery, TestConfig, TestSolrCoreProperties, TestXIncludeConfig, TestLMDirichletSimilarityFactory, TestDefaultSimilarityFactory, TestFastLRUCache, ChaosMonkeyNothingIsSafeTest, SolrTestCaseJ4Test, TestHighlightDedupGrouping, TestTolerantSearch, CollectionsAPIAsyncDistributedZkTest, DeleteReplicaTest, RollingRestartTest, SharedFSAutoReplicaFailoverUtilsTest, SolrXmlInZkTest, TestCloudPivotFacet, TestCollectionAPI, TestModifyConfFiles, TestRequestStatusCollectionAPI, HdfsBasicDistributedZk2Test, HdfsChaosMonkeySafeLeaderTest, HdfsCollectionsAPIDistributedZkTest, HdfsRecoveryZkTest, HdfsSyncSliceTest, ExitableDirectoryReaderTest]
   [junit4] Completed on J1 in 2.67s, 2 tests, 1 failure <<< FAILURES!

[...truncated 196 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:524: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:472: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1359: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:961: There were test failures: 432 suites, 1778 tests, 1 error, 2 failures, 44 ignored (22 assumptions)

Total time: 92 minutes 45 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.9.0-ea-b28 -XX:+UseCompressedOops -XX:+UseParallelGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.7.0_67) - Build # 11349 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11349/
Java: 64bit/jdk1.7.0_67 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
REGRESSION:  org.apache.solr.cloud.CloudExitableDirectoryReaderTest.testDistribSearch

Error Message:
no exception matching expected: 400: Request took too long during query expansion. Terminating request.

Stack Trace:
java.lang.AssertionError: no exception matching expected: 400: Request took too long during query expansion. Terminating request.
	at __randomizedtesting.SeedInfo.seed([19D3E66939E34CC4:983568714EBC2CF8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.assertFail(CloudExitableDirectoryReaderTest.java:101)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTimeoutTests(CloudExitableDirectoryReaderTest.java:75)
	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTest(CloudExitableDirectoryReaderTest.java:54)
	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
	at sun.reflect.GeneratedMethodAccessor51.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11734 lines...]
   [junit4] Suite: org.apache.solr.cloud.CloudExitableDirectoryReaderTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/init-core-data-001
   [junit4]   2> 2312229 T6598 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 2312229 T6598 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 2312232 T6598 oas.SolrTestCaseJ4.setUp ###Starting testDistribSearch
   [junit4]   2> 2312232 T6598 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   1> client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2312233 T6599 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 2312333 T6598 oasc.ZkTestServer.run start zk server on port:41961
   [junit4]   2> 2312333 T6598 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2312334 T6598 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2312336 T6605 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@78a50424 name:ZooKeeperConnection Watcher:127.0.0.1:41961 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2312336 T6598 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2312337 T6598 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2312337 T6598 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 2312340 T6598 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2312341 T6598 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2312342 T6607 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@43dcfed0 name:ZooKeeperConnection Watcher:127.0.0.1:41961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2312342 T6598 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2312342 T6598 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2312342 T6598 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 2312344 T6598 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 2312346 T6598 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 2312347 T6598 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 2312348 T6598 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2312348 T6598 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 2312350 T6598 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 2312350 T6598 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 2312351 T6598 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2312352 T6598 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2312353 T6598 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2312353 T6598 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 2312354 T6598 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2312354 T6598 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 2312355 T6598 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2312356 T6598 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 2312357 T6598 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2312357 T6598 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 2312358 T6598 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2312358 T6598 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2312359 T6598 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2312359 T6598 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2312360 T6598 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2312361 T6598 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 2312362 T6598 oasc.AbstractZkTestCase.putConfig put /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2312362 T6598 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 2312584 T6598 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2312587 T6598 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:43031
   [junit4]   2> 2312588 T6598 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2312588 T6598 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2312588 T6598 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-002
   [junit4]   2> 2312589 T6598 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-002/'
   [junit4]   2> 2312600 T6598 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-002/solr.xml
   [junit4]   2> 2312633 T6598 oasc.CoreContainer.<init> New CoreContainer 1374006271
   [junit4]   2> 2312633 T6598 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-002/]
   [junit4]   2> 2312634 T6598 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2312634 T6598 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2312634 T6598 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2312634 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2312635 T6598 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2312635 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2312635 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2312635 T6598 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2312635 T6598 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2312636 T6598 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2312636 T6598 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2312636 T6598 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2312636 T6598 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2312637 T6598 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41961/solr
   [junit4]   2> 2312637 T6598 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2312637 T6598 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2312638 T6598 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2312639 T6618 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3d7f1c5a name:ZooKeeperConnection Watcher:127.0.0.1:41961 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2312639 T6598 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2312639 T6598 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2312641 T6598 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2312642 T6620 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3e5ebc8e name:ZooKeeperConnection Watcher:127.0.0.1:41961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2312642 T6598 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2312644 T6598 oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 2312648 T6598 oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 2312650 T6598 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 2312652 T6598 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 2312653 T6598 oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 2312654 T6598 oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 2312655 T6598 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43031_
   [junit4]   2> 2312656 T6598 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:43031_
   [junit4]   2> 2312657 T6598 oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 2312658 T6598 oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 2312658 T6598 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2312659 T6598 oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:43031_
   [junit4]   2> 2312660 T6598 oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 2312660 T6598 oasc.Overseer.start Overseer (id=92536876425674755-127.0.0.1:43031_-n_0000000000) starting
   [junit4]   2> 2312662 T6598 oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 2312666 T6598 oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 2312666 T6598 oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 2312666 T6622 oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 2312668 T6598 oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 2312670 T6598 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2312672 T6621 oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 2312675 T6624 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 2312675 T6624 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2312676 T6624 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2312676 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2312679 T6621 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=1 message={
   [junit4]   2> 	  "base_url":"http://127.0.0.1:43031",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "node_name":"127.0.0.1:43031_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"control_collection"}
   [junit4]   2> 2312680 T6621 oasc.Overseer$ClusterStateUpdater.createCollection Create collection control_collection with shards [shard1]
   [junit4]   2> 2312680 T6621 oasc.Overseer$ClusterStateUpdater.createCollection state version control_collection 1
   [junit4]   2> 2312680 T6621 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 2312683 T6625 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2313677 T6624 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2313677 T6624 oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 2313678 T6624 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2313678 T6624 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 2313679 T6624 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2313680 T6624 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-002/collection1/'
   [junit4]   2> 2313680 T6624 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-002/collection1/lib/.svn/' to classloader
   [junit4]   2> 2313681 T6624 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-002/collection1/lib/classes/' to classloader
   [junit4]   2> 2313681 T6624 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-002/collection1/lib/README' to classloader
   [junit4]   2> 2313718 T6624 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 2313743 T6624 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2313746 T6624 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2313752 T6624 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2313987 T6624 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2313991 T6624 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2313992 T6624 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2313999 T6624 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2314001 T6624 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2314003 T6624 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2314004 T6624 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2314004 T6624 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2314004 T6624 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2314005 T6624 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2314005 T6624 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2314005 T6624 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 2314005 T6624 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2314005 T6624 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-002/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/control/data/
   [junit4]   2> 2314005 T6624 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16e0f6ab
   [junit4]   2> 2314006 T6624 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/control/data
   [junit4]   2> 2314006 T6624 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/control/data/index/
   [junit4]   2> 2314006 T6624 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/control/data/index' doesn't exist. Creating new index...
   [junit4]   2> 2314006 T6624 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/control/data/index
   [junit4]   2> 2314007 T6624 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2314007 T6624 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-2e5bd3e)),segFN=segments_1,generation=1}
   [junit4]   2> 2314007 T6624 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2314010 T6624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2314010 T6624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2314010 T6624 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2314010 T6624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2314010 T6624 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2314011 T6624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2314011 T6624 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2314011 T6624 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2314011 T6624 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2314012 T6624 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2314012 T6624 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2314012 T6624 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2314013 T6624 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2314013 T6624 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2314013 T6624 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2314013 T6624 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2314014 T6624 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2314014 T6624 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2314014 T6624 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2314015 T6624 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2314017 T6624 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2314018 T6624 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2314019 T6624 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2314020 T6624 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2314022 T6624 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2314022 T6624 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2314023 T6624 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=19.7548828125, floorSegmentMB=1.4580078125, forceMergeDeletesPctAllowed=17.616635709406662, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.20298112688796532
   [junit4]   2> 2314023 T6624 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-2e5bd3e)),segFN=segments_1,generation=1}
   [junit4]   2> 2314023 T6624 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2314024 T6624 oass.SolrIndexSearcher.<init> Opening Searcher@65138a8b[collection1] main
   [junit4]   2> 2314024 T6624 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 2314025 T6624 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2314025 T6624 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2314026 T6624 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2314026 T6624 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 2314026 T6624 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2314027 T6624 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2314027 T6624 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2314027 T6624 oascc.SolrZkClient.makePath makePath: /configs/conf1/_rest_managed.json
   [junit4]   2> 2314029 T6624 oasr.ManagedResourceStorage$ZooKeeperStorageIO$1.close Wrote 38 bytes to new znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2314029 T6624 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2314029 T6624 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 2314031 T6626 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@65138a8b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2314032 T6624 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2314033 T6629 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:43031 collection:control_collection shard:shard1
   [junit4]   2> 2314033 T6598 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 2314034 T6598 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2314034 T6629 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 2314034 T6598 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2314035 T6598 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2314036 T6631 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@49c9c229 name:ZooKeeperConnection Watcher:127.0.0.1:41961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2314036 T6598 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2314037 T6598 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2314037 T6598 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2314038 T6629 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 2314039 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2314040 T6598 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 2314040 T6629 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2314040 T6629 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3013 name=collection1 org.apache.solr.core.SolrCore@2b291673 url=http://127.0.0.1:43031/collection1 node=127.0.0.1:43031_ C3013_STATE=coll:control_collection core:collection1 props:{base_url=http://127.0.0.1:43031, core=collection1, state=down, node_name=127.0.0.1:43031_}
   [junit4]   2> 2314040 T6629 C3013 P43031 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:43031/collection1/
   [junit4]   2> 2314040 T6629 C3013 P43031 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2314041 T6629 C3013 P43031 oasc.SyncStrategy.syncToMe http://127.0.0.1:43031/collection1/ has no replicas
   [junit4]   2> 2314041 T6629 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:43031/collection1/ shard1
   [junit4]   2> 2314041 T6629 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 2314044 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2314147 T6625 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2314147 T6632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2314195 T6629 oasc.ZkController.register We are http://127.0.0.1:43031/collection1/ and leader is http://127.0.0.1:43031/collection1/
   [junit4]   2> 2314195 T6629 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43031
   [junit4]   2> 2314195 T6629 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2314195 T6629 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 2314195 T6629 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2314197 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2314199 T6621 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "base_url":"http://127.0.0.1:43031",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1:43031_",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"}
   [junit4]   2> 2314262 T6598 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1
   [junit4]   2> 2314262 T6598 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2314264 T6598 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:39033
   [junit4]   2> 2314265 T6598 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2314265 T6598 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2314265 T6598 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-003
   [junit4]   2> 2314265 T6598 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-003/'
   [junit4]   2> 2314276 T6598 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-003/solr.xml
   [junit4]   2> 2314305 T6632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2314305 T6625 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 2314315 T6598 oasc.CoreContainer.<init> New CoreContainer 16828809
   [junit4]   2> 2314316 T6598 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-003/]
   [junit4]   2> 2314316 T6598 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2314317 T6598 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2314317 T6598 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2314317 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2314317 T6598 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2314318 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2314318 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2314318 T6598 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2314318 T6598 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2314319 T6598 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2314319 T6598 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2314319 T6598 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2314320 T6598 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2314320 T6598 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41961/solr
   [junit4]   2> 2314320 T6598 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2314321 T6598 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2314321 T6598 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2314322 T6643 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5aaf41e2 name:ZooKeeperConnection Watcher:127.0.0.1:41961 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2314323 T6598 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2314323 T6598 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2314325 T6598 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2314327 T6645 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@3bee5520 name:ZooKeeperConnection Watcher:127.0.0.1:41961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2314327 T6598 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2314334 T6598 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2315337 T6598 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39033_
   [junit4]   2> 2315339 T6598 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:39033_
   [junit4]   2> 2315352 T6598 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2315358 T6647 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 2315359 T6647 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2315360 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2315360 T6647 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2315362 T6621 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "base_url":"http://127.0.0.1:39033",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "node_name":"127.0.0.1:39033_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1"}
   [junit4]   2> 2315363 T6621 oasc.Overseer$ClusterStateUpdater.createCollection Create collection collection1 with shards [shard1, shard2]
   [junit4]   2> 2315363 T6621 oasc.Overseer$ClusterStateUpdater.createCollection state version collection1 1
   [junit4]   2> 2315363 T6621 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 2315466 T6625 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2315466 T6646 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2315466 T6632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2316360 T6647 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2316361 T6647 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 2316361 T6647 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2316362 T6647 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2316363 T6647 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2316363 T6647 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-003/collection1/'
   [junit4]   2> 2316364 T6647 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-003/collection1/lib/.svn/' to classloader
   [junit4]   2> 2316364 T6647 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-003/collection1/lib/classes/' to classloader
   [junit4]   2> 2316364 T6647 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-003/collection1/lib/README' to classloader
   [junit4]   2> 2316396 T6647 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 2316416 T6647 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2316417 T6647 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2316422 T6647 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2316638 T6647 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2316642 T6647 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2316644 T6647 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2316652 T6647 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2316655 T6647 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2316657 T6647 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2316657 T6647 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2316658 T6647 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2316658 T6647 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2316658 T6647 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2316658 T6647 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2316659 T6647 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 2316659 T6647 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2316659 T6647 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-003/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/jetty1/
   [junit4]   2> 2316659 T6647 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16e0f6ab
   [junit4]   2> 2316660 T6647 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/jetty1
   [junit4]   2> 2316660 T6647 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/jetty1/index/
   [junit4]   2> 2316660 T6647 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/jetty1/index' doesn't exist. Creating new index...
   [junit4]   2> 2316661 T6647 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/jetty1/index
   [junit4]   2> 2316661 T6647 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2316662 T6647 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-7538d3e2)),segFN=segments_1,generation=1}
   [junit4]   2> 2316662 T6647 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2316665 T6647 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2316666 T6647 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2316666 T6647 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2316666 T6647 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2316666 T6647 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2316666 T6647 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2316667 T6647 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2316667 T6647 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2316667 T6647 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2316668 T6647 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2316668 T6647 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2316668 T6647 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2316669 T6647 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2316669 T6647 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2316669 T6647 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2316670 T6647 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2316670 T6647 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2316670 T6647 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2316671 T6647 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2316671 T6647 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2316674 T6647 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2316675 T6647 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2316676 T6647 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2316677 T6647 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2316679 T6647 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2316680 T6647 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2316680 T6647 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=19.7548828125, floorSegmentMB=1.4580078125, forceMergeDeletesPctAllowed=17.616635709406662, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.20298112688796532
   [junit4]   2> 2316681 T6647 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-7538d3e2)),segFN=segments_1,generation=1}
   [junit4]   2> 2316681 T6647 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2316681 T6647 oass.SolrIndexSearcher.<init> Opening Searcher@28da9344[collection1] main
   [junit4]   2> 2316681 T6647 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2316682 T6647 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2316682 T6647 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2316683 T6647 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2316683 T6647 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 2316683 T6647 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2316684 T6647 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2316684 T6647 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2316684 T6647 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 2316684 T6647 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 2316688 T6648 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@28da9344[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2316691 T6647 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2316692 T6651 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:39033 collection:collection1 shard:shard2
   [junit4]   2> 2316692 T6598 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 2316693 T6598 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2316693 T6651 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard2/election
   [junit4]   2> 2316698 T6651 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard2
   [junit4]   2> 2316700 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2316700 T6651 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2316700 T6651 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3014 name=collection1 org.apache.solr.core.SolrCore@58e2e69f url=http://127.0.0.1:39033/collection1 node=127.0.0.1:39033_ C3014_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:39033, core=collection1, state=down, node_name=127.0.0.1:39033_}
   [junit4]   2> 2316700 T6651 C3014 P39033 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:39033/collection1/
   [junit4]   2> 2316701 T6651 C3014 P39033 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2316701 T6651 C3014 P39033 oasc.SyncStrategy.syncToMe http://127.0.0.1:39033/collection1/ has no replicas
   [junit4]   2> 2316701 T6651 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:39033/collection1/ shard2
   [junit4]   2> 2316701 T6651 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard2
   [junit4]   2> 2316704 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2316806 T6625 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2316806 T6632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2316806 T6646 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2316855 T6651 oasc.ZkController.register We are http://127.0.0.1:39033/collection1/ and leader is http://127.0.0.1:39033/collection1/
   [junit4]   2> 2316855 T6651 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:39033
   [junit4]   2> 2316855 T6651 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2316855 T6651 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 2316855 T6651 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2316856 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2316858 T6621 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "base_url":"http://127.0.0.1:39033",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1:39033_",
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "shard":"shard2",
   [junit4]   2> 	  "collection":"collection1"}
   [junit4]   2> 2316918 T6598 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2
   [junit4]   2> 2316919 T6598 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2316921 T6598 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:54360
   [junit4]   2> 2316923 T6598 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2316923 T6598 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2316923 T6598 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-004
   [junit4]   2> 2316923 T6598 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-004/'
   [junit4]   2> 2316933 T6598 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-004/solr.xml
   [junit4]   2> 2316960 T6646 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2316960 T6632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2316960 T6625 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 2316974 T6598 oasc.CoreContainer.<init> New CoreContainer 203455862
   [junit4]   2> 2316974 T6598 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-004/]
   [junit4]   2> 2316975 T6598 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2316975 T6598 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2316976 T6598 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2316976 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2316976 T6598 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2316977 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2316977 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2316977 T6598 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2316978 T6598 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2316978 T6598 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2316979 T6598 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2316979 T6598 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2316980 T6598 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2316980 T6598 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41961/solr
   [junit4]   2> 2316980 T6598 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2316981 T6598 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2316982 T6598 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2316984 T6662 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@290cd432 name:ZooKeeperConnection Watcher:127.0.0.1:41961 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2316984 T6598 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2316984 T6598 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2316987 T6598 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2316988 T6664 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@66c85e55 name:ZooKeeperConnection Watcher:127.0.0.1:41961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2316988 T6598 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2316995 T6598 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2317998 T6598 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54360_
   [junit4]   2> 2317999 T6598 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:54360_
   [junit4]   2> 2318003 T6598 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2318009 T6666 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 2318009 T6666 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2318010 T6666 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2318010 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2318014 T6621 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54360",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "node_name":"127.0.0.1:54360_",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "collection":"collection1"}
   [junit4]   2> 2318015 T6621 oasc.Overseer$ClusterStateUpdater.updateState Collection already exists with numShards=2
   [junit4]   2> 2318015 T6621 oasc.Overseer$ClusterStateUpdater.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 2318118 T6632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2318118 T6646 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2318118 T6625 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2318118 T6665 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2319011 T6666 oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 2319011 T6666 oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 2319012 T6666 oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 2319012 T6666 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2319013 T6666 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2319014 T6666 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-004/collection1/'
   [junit4]   2> 2319015 T6666 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-004/collection1/lib/.svn/' to classloader
   [junit4]   2> 2319015 T6666 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-004/collection1/lib/classes/' to classloader
   [junit4]   2> 2319016 T6666 oasc.SolrResourceLoader.replaceClassLoader Adding 'file:/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-004/collection1/lib/README' to classloader
   [junit4]   2> 2319044 T6666 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 2319085 T6666 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 2319087 T6666 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 2319095 T6666 oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 2319278 T6666 oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 2319282 T6666 oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 2319283 T6666 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 2319292 T6666 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2319294 T6666 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 2319297 T6666 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2319298 T6666 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2319298 T6666 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2319298 T6666 oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 2319299 T6666 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 2319299 T6666 oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 2319299 T6666 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 2319299 T6666 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 2319300 T6666 oasc.SolrCore.<init> [collection1] Opening new SolrCore at ../../../../../../../../../../mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-004/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/jetty2/
   [junit4]   2> 2319300 T6666 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@16e0f6ab
   [junit4]   2> 2319301 T6666 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/jetty2
   [junit4]   2> 2319301 T6666 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/jetty2/index/
   [junit4]   2> 2319301 T6666 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/jetty2/index' doesn't exist. Creating new index...
   [junit4]   2> 2319301 T6666 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/jetty2/index
   [junit4]   2> 2319302 T6666 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=19, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2319302 T6666 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-51b00c42)),segFN=segments_1,generation=1}
   [junit4]   2> 2319302 T6666 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2319305 T6666 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 2319305 T6666 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 2319306 T6666 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 2319306 T6666 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2319306 T6666 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 2319306 T6666 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 2319307 T6666 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2319307 T6666 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 2319307 T6666 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 2319307 T6666 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2319308 T6666 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2319308 T6666 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 2319309 T6666 oasc.RequestHandlers.initHandlersFromConfig created standard: solr.StandardRequestHandler
   [junit4]   2> 2319309 T6666 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 2319309 T6666 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.ReplicationHandler
   [junit4]   2> 2319309 T6666 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 2319310 T6666 oasc.RequestHandlers.initHandlersFromConfig created /update: solr.UpdateRequestHandler
   [junit4]   2> 2319310 T6666 oasc.RequestHandlers.initHandlersFromConfig created /admin/: org.apache.solr.handler.admin.AdminHandlers
   [junit4]   2> 2319310 T6666 oasc.RequestHandlers.initHandlersFromConfig created /admin/file: solr.admin.ShowFileRequestHandler
   [junit4]   2> 2319311 T6666 oasc.RequestHandlers.initHandlersFromConfig created /admin/fileedit: solr.admin.EditFileRequestHandler
   [junit4]   2> 2319313 T6666 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2319314 T6666 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2319315 T6666 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2319316 T6666 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 2319317 T6666 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 2319317 T6666 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 2319318 T6666 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=25, maxMergeAtOnceExplicit=38, maxMergedSegmentMB=19.7548828125, floorSegmentMB=1.4580078125, forceMergeDeletesPctAllowed=17.616635709406662, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.20298112688796532
   [junit4]   2> 2319318 T6666 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-51b00c42)),segFN=segments_1,generation=1}
   [junit4]   2> 2319318 T6666 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 2319319 T6666 oass.SolrIndexSearcher.<init> Opening Searcher@27a7c7ae[collection1] main
   [junit4]   2> 2319319 T6666 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 2319320 T6666 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 2319320 T6666 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 2319321 T6666 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2319321 T6666 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 2319321 T6666 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2319321 T6666 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream Read 38 bytes from znode /configs/conf1/_rest_managed.json
   [junit4]   2> 2319322 T6666 oasr.ManagedResourceStorage.load Loaded LinkedHashMap at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2319322 T6666 oasr.ManagedResource.reloadFromStorage Loaded initArgs {} for /rest/managed
   [junit4]   2> 2319322 T6666 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 2319324 T6667 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@27a7c7ae[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2319326 T6666 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 2319327 T6670 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:54360 collection:collection1 shard:shard1
   [junit4]   2> 2319327 T6598 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 2319327 T6598 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 2319328 T6670 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 2319331 T6670 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 2319331 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2319332 T6670 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 2319332 T6670 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3015 name=collection1 org.apache.solr.core.SolrCore@502d69ba url=http://127.0.0.1:54360/collection1 node=127.0.0.1:54360_ C3015_STATE=coll:collection1 core:collection1 props:{base_url=http://127.0.0.1:54360, core=collection1, state=down, node_name=127.0.0.1:54360_}
   [junit4]   2> 2319332 T6670 C3015 P54360 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:54360/collection1/
   [junit4]   2> 2319332 T6670 C3015 P54360 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 2319332 T6670 C3015 P54360 oasc.SyncStrategy.syncToMe http://127.0.0.1:54360/collection1/ has no replicas
   [junit4]   2> 2319332 T6670 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:54360/collection1/ shard1
   [junit4]   2> 2319333 T6670 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 2319335 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2319437 T6665 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2319437 T6632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2319437 T6625 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2319437 T6646 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2319486 T6670 oasc.ZkController.register We are http://127.0.0.1:54360/collection1/ and leader is http://127.0.0.1:54360/collection1/
   [junit4]   2> 2319486 T6670 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:54360
   [junit4]   2> 2319486 T6670 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 2319486 T6670 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 2319486 T6670 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2319488 T6625 oasc.DistributedQueue$LatchChildWatcher.process LatchChildWatcher fired on path: /overseer/queue state: SyncConnected type NodeChildrenChanged
   [junit4]   2> 2319490 T6621 oasc.Overseer$ClusterStateUpdater.updateState Update state numShards=2 message={
   [junit4]   2> 	  "base_url":"http://127.0.0.1:54360",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "roles":null,
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "node_name":"127.0.0.1:54360_",
   [junit4]   2> 	  "core_node_name":"core_node2",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1"}
   [junit4]   2> 2319572 T6598 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 3
   [junit4]   2> 2319573 T6598 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 2319575 T6598 oejs.AbstractConnector.doStart Started SelectChannelConnector@127.0.0.1:55891
   [junit4]   2> 2319576 T6598 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 2319576 T6598 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 2319576 T6598 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-005
   [junit4]   2> 2319577 T6598 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-005/'
   [junit4]   2> 2319587 T6598 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-005/solr.xml
   [junit4]   2> 2319607 T6646 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2319607 T6625 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2319607 T6665 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2319607 T6632 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 2319609 T6598 oasc.CoreContainer.<init> New CoreContainer 1755637414
   [junit4]   2> 2319609 T6598 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-005/]
   [junit4]   2> 2319610 T6598 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 90000
   [junit4]   2> 2319610 T6598 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: 
   [junit4]   2> 2319610 T6598 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 15000
   [junit4]   2> 2319611 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 2319611 T6598 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 2319611 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 2319611 T6598 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 2319611 T6598 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 2319612 T6598 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 2319612 T6598 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=false
   [junit4]   2> 2319612 T6598 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 2319612 T6598 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 2319613 T6598 oasc.CoreContainer.load Host Name: 127.0.0.1
   [junit4]   2> 2319613 T6598 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:41961/solr
   [junit4]   2> 2319613 T6598 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 2319613 T6598 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 2319614 T6598 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2319616 T6681 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1c067efc name:ZooKeeperConnection Watcher:127.0.0.1:41961 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2319616 T6598 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2319616 T6598 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 2319618 T6598 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 2319620 T6683 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@5b5b5d28 name:ZooKeeperConnection Watcher:127.0.0.1:41961/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 2319620 T6598 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 2319626 T6598 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 2320629 T6598 oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55891_
   [junit4]   2> 2320630 T6598 oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:55891_
   [junit4]   2> 2320635 T6598 oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 2320643 T6685 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 2320643 T6685 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 2320644 T6685 oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 2320644 T6625 oasc.DistributedQueue$LatchChildWatcher.p

[...truncated too long message...]

tory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001/tempDir-001/jetty4/index
   [junit4]   2> 2396527 T6598 oasc.Overseer.close Overseer (id=92536876425674764-127.0.0.1:48545_-n_0000000004) closing
   [junit4]   2> 2396527 T6742 oasc.Overseer$ClusterStateUpdater.run Overseer Loop exiting : 127.0.0.1:48545_
   [junit4]   2> 2398032 T6737 oascc.ZkStateReader$3.process WARN ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 2398057 T6598 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/,null}
   [junit4]   2> 2403046 T6598 oas.SolrTestCaseJ4.tearDown ###Ending testDistribSearch
   [junit4]   2> 2403048 T6598 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41961 41961
   [junit4]   2> 2403468 T6599 oasc.ZkTestServer.send4LetterWord connecting to 127.0.0.1:41961 41961
   [junit4]   2> 2403470 T6599 oasc.ZkTestServer$ZKServerMain.runFromConfig WARN Watch limit violations: 
   [junit4]   2> 	Maximum concurrent create/delete watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		6	/solr/aliases.json
   [junit4]   2> 		6	/solr/clusterstate.json
   [junit4]   2> 	
   [junit4]   2> 	Maximum concurrent children watches above limit:
   [junit4]   2> 	
   [junit4]   2> 		6	/solr/live_nodes
   [junit4]   2> 		5	/solr/overseer/collection-queue-work
   [junit4]   2> 		4	/solr/overseer/queue
   [junit4]   2> 	
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CloudExitableDirectoryReaderTest -Dtests.method=testDistribSearch -Dtests.seed=19D3E66939E34CC4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en_IE -Dtests.timezone=ART -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 91.3s J1 | CloudExitableDirectoryReaderTest.testDistribSearch <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: no exception matching expected: 400: Request took too long during query expansion. Terminating request.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([19D3E66939E34CC4:983568714EBC2CF8]:0)
   [junit4]    > 	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.assertFail(CloudExitableDirectoryReaderTest.java:101)
   [junit4]    > 	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTimeoutTests(CloudExitableDirectoryReaderTest.java:75)
   [junit4]    > 	at org.apache.solr.cloud.CloudExitableDirectoryReaderTest.doTest(CloudExitableDirectoryReaderTest.java:54)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.testDistribSearch(BaseDistributedSearchTestCase.java:869)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 2403490 T6598 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CloudExitableDirectoryReaderTest-19D3E66939E34CC4-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=en_IE, timezone=ART
   [junit4]   2> NOTE: Linux 3.13.0-36-generic amd64/Oracle Corporation 1.7.0_67 (64-bit)/cpus=8,threads=1,free=54871448,total=222527488
   [junit4]   2> NOTE: All tests run in this JVM: [OutputWriterTest, ScriptEngineTest, TestPHPSerializedResponseWriter, SchemaVersionSpecificBehaviorTest, TestNoOpRegenerator, TestJoin, DistributedQueryComponentCustomSortTest, SuggestComponentTest, CursorMarkTest, HdfsSyncSliceTest, DeleteInactiveReplicaTest, StressHdfsTest, TestInfoStreamLogging, SolrCoreTest, TestNRTOpen, CoreContainerCoreInitFailuresTest, ResponseHeaderTest, TestPseudoReturnFields, TestRecovery, HdfsDirectoryTest, TestManagedResourceStorage, TestCopyFieldCollectionResource, AnalyticsQueryTest, TestFiltering, TestIBSimilarityFactory, DistribDocExpirationUpdateProcessorTest, TestCollationField, BadCopyFieldTest, SpatialFilterTest, ChaosMonkeySafeLeaderTest, SharedFSAutoReplicaFailoverTest, TestDistributedGrouping, TestAtomicUpdateErrorCases, ModifyConfFileTest, TestRealTimeGet, LoggingHandlerTest, ShardRoutingCustomTest, StatsComponentTest, TestLazyCores, TestCSVLoader, AlternateDirectoryTest, PreAnalyzedFieldTest, FullSolrCloudDistribCmdsTest, TestRestManager, CopyFieldTest, SimplePostToolTest, UniqFieldsUpdateProcessorFactoryTest, ZkSolrClientTest, TestFieldSortValues, SolrIndexConfigTest, TestSolrXmlPersistence, ChangedSchemaMergeTest, CoreMergeIndexesAdminHandlerTest, OpenCloseCoreStressTest, RollingRestartTest, TestPhraseSuggestions, DistributedQueryComponentOptimizationTest, TestReRankQParserPlugin, SoftAutoCommitTest, TestMultiCoreConfBootstrap, AssignTest, TestFieldTypeCollectionResource, MigrateRouteKeyTest, AnalyticsMergeStrategyTest, EnumFieldTest, TestComplexPhraseQParserPlugin, TestOmitPositions, DistanceFunctionTest, CurrencyFieldXmlFileTest, UUIDFieldTest, TermVectorComponentTest, TestJmxMonitoredMap, DateMathParserTest, TestFieldCollectionResource, SOLR749Test, UpdateRequestProcessorFactoryTest, TestQueryUtils, TestBinaryField, TestZkChroot, TestTolerantSearch, SearchHandlerTest, TestElisionMultitermQuery, SuggesterFSTTest, TestFieldResource, SolrXmlInZkTest, DefaultValueUpdateProcessorTest, TestNonNRTOpen, TestExtendedDismaxParser, HardAutoCommitTest, TestManagedSchemaDynamicFieldResource, DirectUpdateHandlerOptimizeTest, TestHighlightDedupGrouping, LukeRequestHandlerTest, LeaderElectionIntegrationTest, TestInitParams, MultiTermTest, ResourceLoaderTest, TestSolrQueryParser, TestSchemaNameResource, TestCharFilters, FieldAnalysisRequestHandlerTest, HdfsWriteToMultipleCollectionsTest, SolrRequestParserTest, TestMergePolicyConfig, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, SyncSliceTest, BasicZkTest, RecoveryZkTest, TestRandomFaceting, ZkCLITest, TestDistributedSearch, AutoCommitTest, TestHashPartitioner, DistributedSpellCheckComponentTest, TermVectorComponentDistributedTest, TestStressReorder, DistributedTermsComponentTest, TestRangeQuery, TestCoreContainer, SimpleFacetsTest, TestGroupingSearch, QueryElevationComponentTest, ConvertedLegacyTest, TestSort, TestFunctionQuery, BasicFunctionalityTest, TestBadConfig, TestIndexSearcher, HighlighterTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, CoreAdminHandlerTest, DocValuesTest, SuggesterTSTTest, TestStressLucene, PolyFieldTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, TestUpdate, FieldMutatingUpdateProcessorTest, QueryEqualityTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, TestRemoteStreaming, DocValuesMultiTest, TestSolrDeletionPolicy1, SolrInfoMBeanTest, XsltUpdateRequestHandlerTest, DebugComponentTest, CacheHeaderTest, DisMaxRequestHandlerTest, TestWriterPerf, TestReversedWildcardFilterFactory, DocumentAnalysisRequestHandlerTest, TestQueryTypes, FileBasedSpellCheckerTest, XmlUpdateRequestHandlerTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, TestIndexingPerformance, RequiredFieldsTest, TestArbitraryIndexDir, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, SolrPluginUtilsTest, IndexSchemaTest, ReturnFieldsTest, JSONWriterTest, TestCSVResponseWriter, MBeansHandlerTest, QueryParsingTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, PingRequestHandlerTest, CSVRequestHandlerTest, TestComponentsName, TestBinaryResponseWriter, TestLFUCache, HighlighterConfigTest, UpdateParamsTest, TestSolrIndexConfig, TestQuerySenderNoQuery, TestSolrDeletionPolicy2, SampleTest, TestDocSet, TestSearchPerf, NumericFieldsTest, MinimalSchemaTest, TestConfig, TestPostingsSolrHighlighter, DirectSolrConnectionTest, SpellPossibilityIteratorTest, SynonymTokenizerTest, TestXIncludeConfig, TestSweetSpotSimilarityFactory, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, LegacyHTMLStripCharFilterTest, TimeZoneUtilsTest, URLClassifyProcessorTest, ChaosMonkeyNothingIsSafeTest, TestSystemIdResolver, PrimUtilsTest, DateFieldTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, ClusterStateTest, TestSolrJ, TestUtils, TestDocumentBuilder, SliceStateTest, FileUtilsTest, CircularListTest, TestRTGBase, DistributedIntervalFacetingTest, TestDistributedMissingSort, AsyncMigrateRouteKeyTest, CloudExitableDirectoryReaderTest]
   [junit4] Completed on J1 in 91.28s, 1 test, 1 failure <<< FAILURES!

[...truncated 297 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:524: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:472: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:189: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1359: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:961: There were test failures: 432 suites, 1778 tests, 1 failure, 44 ignored (22 assumptions)

Total time: 96 minutes 0 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 64bit/jdk1.7.0_67 -XX:+UseCompressedOops -XX:+UseSerialGC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_40-ea-b04) - Build # 11348 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/11348/
Java: 32bit/jdk1.8.0_40-ea-b04 -server -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.client.solrj.SolrSchemalessExampleTest.testStreamingRequest

Error Message:
IOException occured when talking to server at: https://127.0.0.1:38679/solr/collection1

Stack Trace:
org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:38679/solr/collection1
	at __randomizedtesting.SeedInfo.seed([CD54FC8755960C32:ABD8489779DA761]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:585)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
	at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:168)
	at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:146)
	at org.apache.solr.client.solrj.SolrExampleTestsBase.testStreamingRequest(SolrExampleTestsBase.java:219)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:483)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1618)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:877)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:738)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:772)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:783)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:53)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesInvariantRule$1.evaluate(SystemPropertiesInvariantRule.java:55)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:43)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:466)
	... 46 more




Build Log:
[...truncated 12474 lines...]
   [junit4] Suite: org.apache.solr.client.solrj.SolrSchemalessExampleTest
   [junit4]   2> Creating dataDir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/init-core-data-001
   [junit4]   2> 8283 T64 oas.SolrTestCaseJ4.buildSSLConfig Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 10124 T64 oas.SolrTestCaseJ4.initCore ####initCore
   [junit4]   2> 10124 T64 oas.SolrTestCaseJ4.initCore ####initCore end
   [junit4]   2> 10153 T64 oejs.Server.doStart jetty-8.1.10.v20130312
   [junit4]   2> 10285 T64 oejus.SslContextFactory.doStart Enabled Protocols [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2] of [SSLv2Hello, SSLv3, TLSv1, TLSv1.1, TLSv1.2]
   [junit4]   2> 10565 T64 oejs.AbstractConnector.doStart Started SslSelectChannelConnector@127.0.0.1:38679
   [junit4]   2> 10574 T64 oass.SolrDispatchFilter.init SolrDispatchFilter.init()
   [junit4]   2> 10576 T64 oasc.SolrResourceLoader.locateSolrHome JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 10576 T64 oasc.SolrResourceLoader.locateSolrHome using system property solr.solr.home: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001
   [junit4]   2> 10576 T64 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/'
   [junit4]   2> 10588 T64 oasc.ConfigSolr.fromFile Loading container configuration from /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/solr.xml
   [junit4]   2> 10599 T64 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001
   [junit4]   2> 10600 T64 oasc.CoreContainer.<init> New CoreContainer 24366081
   [junit4]   2> 10600 T64 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/]
   [junit4]   2> 10601 T64 oashc.HttpShardHandlerFactory.getParameter Setting socketTimeout to: 0
   [junit4]   2> 10602 T64 oashc.HttpShardHandlerFactory.getParameter Setting urlScheme to: null
   [junit4]   2> 10602 T64 oashc.HttpShardHandlerFactory.getParameter Setting connTimeout to: 0
   [junit4]   2> 10602 T64 oashc.HttpShardHandlerFactory.getParameter Setting maxConnectionsPerHost to: 20
   [junit4]   2> 10603 T64 oashc.HttpShardHandlerFactory.getParameter Setting corePoolSize to: 0
   [junit4]   2> 10603 T64 oashc.HttpShardHandlerFactory.getParameter Setting maximumPoolSize to: 2147483647
   [junit4]   2> 10603 T64 oashc.HttpShardHandlerFactory.getParameter Setting maxThreadIdleTime to: 5
   [junit4]   2> 10604 T64 oashc.HttpShardHandlerFactory.getParameter Setting sizeOfQueue to: -1
   [junit4]   2> 10604 T64 oashc.HttpShardHandlerFactory.getParameter Setting fairnessPolicy to: false
   [junit4]   2> 10606 T64 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=0&connTimeout=0&retry=false
   [junit4]   2> 10607 T64 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 10608 T64 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 10608 T64 oasc.CoreContainer.load Host Name: 
   [junit4]   2> 10610 T64 oasc.CorePropertiesLocator.discover Looking for core definitions underneath /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001
   [junit4]   2> 10613 T64 oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/
   [junit4]   2> 10613 T64 oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 10614 T74 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/'
   [junit4]   2> 10647 T74 oasc.SolrConfig.initLibs Adding specified lib dirs to ClassLoader
   [junit4]   2> 10648 T74 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../contrib/extraction/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/../../../../contrib/extraction/lib).
   [junit4]   2> 10649 T74 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/../../../../dist).
   [junit4]   2> 10649 T74 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../contrib/clustering/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/../../../../contrib/clustering/lib).
   [junit4]   2> 10649 T74 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/../../../../dist).
   [junit4]   2> 10650 T74 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../contrib/langid/lib/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/../../../../contrib/langid/lib).
   [junit4]   2> 10650 T74 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/../../../../dist).
   [junit4]   2> 10651 T74 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../contrib/velocity/lib (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/../../../../contrib/velocity/lib).
   [junit4]   2> 10651 T74 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: ../../../../dist/ (resolved as: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/../../../../dist).
   [junit4]   2> 10678 T74 oasc.SolrConfig.<init> Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 10729 T74 oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 10736 T74 oass.ManagedIndexSchemaFactory.readSchemaLocally The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 10742 T74 oass.IndexSchema.readSchema Reading Solr Schema from schema.xml
   [junit4]   2> 10758 T74 oass.IndexSchema.readSchema [collection1] Schema name=example-schemaless
   [junit4]   2> 10965 T74 oasc.SolrResourceLoader.findClass WARN Solr loaded a deprecated plugin/analysis class [solr.ThaiWordFilterFactory]. Please consult documentation how to replace it accordingly.
   [junit4]   2> 10978 T74 oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 11001 T74 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 11006 T74 oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 11047 T74 oass.ManagedIndexSchema.persistManagedSchema Upgraded to managed schema at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/conf/managed-schema
   [junit4]   2> 18544 T74 oass.ManagedIndexSchemaFactory.upgradeToManagedSchema After upgrading to managed schema, renamed the non-managed schema /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/conf/schema.xml to /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/conf/schema.xml.bak
   [junit4]   2> 18545 T74 oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from instancedir /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/
   [junit4]   2> 18545 T74 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 18545 T74 oasc.SolrCore.<init> [collection1] Opening new SolrCore at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/, dataDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-002/
   [junit4]   2> 18546 T74 oasc.JmxMonitoredMap.<init> No JMX servers found, not exposing Solr information with JMX.
   [junit4]   2> 18546 T74 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]}
   [junit4]   2> 18546 T74 oasc.SolrCore.initListeners [collection1] Added SolrEventListener for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[]}
   [junit4]   2> 18547 T74 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-002
   [junit4]   2> 18547 T74 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-002/index/
   [junit4]   2> 18547 T74 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-002/index' doesn't exist. Creating new index...
   [junit4]   2> 18548 T74 oasc.CachingDirectoryFactory.get return new directory for /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-002/index
   [junit4]   2> 18548 T74 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_1,generation=1}
   [junit4]   2> 18548 T74 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 18549 T74 oasc.SolrCore.initWriters created json: solr.JSONResponseWriter
   [junit4]   2> 18549 T74 oasc.SolrCore.initWriters adding lazy queryResponseWriter: solr.VelocityResponseWriter
   [junit4]   2> 18549 T74 oasc.SolrCore.initWriters created velocity: solr.VelocityResponseWriter
   [junit4]   2> 18550 T74 oasc.SolrCore.initWriters created xslt: solr.XSLTResponseWriter
   [junit4]   2> 18550 T74 oasr.XSLTResponseWriter.init xsltCacheLifetimeSeconds=5
   [junit4]   2> 18551 T74 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "add-unknown-fields-to-the-schema"
   [junit4]   2> 18696 T74 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 18697 T74 oasc.RequestHandlers.initHandlersFromConfig created /update/csv: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 18697 T74 oasc.RequestHandlers.initHandlersFromConfig created /update/json: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 18697 T74 oasc.RequestHandlers.initHandlersFromConfig created /update/json/docs: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 18697 T74 oasc.RequestHandlers.initHandlersFromConfig created /update: org.apache.solr.handler.UpdateRequestHandler
   [junit4]   2> 18698 T74 oasc.RequestHandlers.initHandlersFromConfig created /select: solr.SearchHandler
   [junit4]   2> 18698 T74 oasc.RequestHandlers.initHandlersFromConfig created /query: solr.SearchHandler
   [junit4]   2> 18698 T74 oasc.RequestHandlers.initHandlersFromConfig created /get: solr.RealTimeGetHandler
   [junit4]   2> 18698 T74 oasc.RequestHandlers.initHandlersFromConfig created /browse: solr.SearchHandler
   [junit4]   2> 18698 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.extraction.ExtractingRequestHandler
   [junit4]   2> 18699 T74 oasc.RequestHandlers.initHandlersFromConfig created /update/extract: solr.extraction.ExtractingRequestHandler
   [junit4]   2> 18699 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.FieldAnalysisRequestHandler
   [junit4]   2> 18699 T74 oasc.RequestHandlers.initHandlersFromConfig created /analysis/field: solr.FieldAnalysisRequestHandler
   [junit4]   2> 18699 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.DocumentAnalysisRequestHandler
   [junit4]   2> 18699 T74 oasc.RequestHandlers.initHandlersFromConfig created /analysis/document: solr.DocumentAnalysisRequestHandler
   [junit4]   2> 18699 T74 oasc.RequestHandlers.initHandlersFromConfig created /admin/: solr.admin.AdminHandlers
   [junit4]   2> 18700 T74 oasc.RequestHandlers.initHandlersFromConfig created /admin/ping: solr.PingRequestHandler
   [junit4]   2> 18700 T74 oasc.RequestHandlers.initHandlersFromConfig created /debug/dump: solr.DumpRequestHandler
   [junit4]   2> 18700 T74 oasc.RequestHandlers.initHandlersFromConfig created /replication: solr.ReplicationHandler
   [junit4]   2> 18700 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 18700 T74 oasc.RequestHandlers.initHandlersFromConfig created /spell: solr.SearchHandler
   [junit4]   2> 18701 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 18701 T74 oasc.RequestHandlers.initHandlersFromConfig created /tvrh: solr.SearchHandler
   [junit4]   2> 18701 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 18701 T74 oasc.RequestHandlers.initHandlersFromConfig created /terms: solr.SearchHandler
   [junit4]   2> 18701 T74 oasc.RequestHandlers.initHandlersFromConfig adding lazy requestHandler: solr.SearchHandler
   [junit4]   2> 18701 T74 oasc.RequestHandlers.initHandlersFromConfig created /elevate: solr.SearchHandler
   [junit4]   2> 18703 T74 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 18704 T74 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 18704 T74 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 18705 T74 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 18708 T74 oasu.CommitTracker.<init> Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 18708 T74 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 18709 T74 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_1,generation=1}
   [junit4]   2> 18709 T74 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 18709 T74 oass.SolrIndexSearcher.<init> Opening Searcher@f5b595[collection1] main
   [junit4]   2> 18710 T74 oasr.ManagedResourceStorage$FileStorageIO.configure File-based storage initialized to use dir: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/conf
   [junit4]   2> 18710 T74 oasr.RestManager.init Initializing RestManager with initArgs: {storageDir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/conf}
   [junit4]   2> 18710 T74 oasr.ManagedResourceStorage.load Reading _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/conf
   [junit4]   2> 18711 T74 oasr.ManagedResource.reloadFromStorage WARN No stored data found for /rest/managed
   [junit4]   2> 18711 T74 oasr.ManagedResourceStorage$JsonStorage.store Saved JSON object to path _rest_managed.json using file:dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/conf
   [junit4]   2> 18711 T74 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 18711 T74 oashc.SpellCheckComponent.inform Initializing spell checkers
   [junit4]   2> 18711 T74 oass.DirectSolrSpellChecker.init init: {name=default,field=text,classname=solr.DirectSolrSpellChecker,distanceMeasure=internal,accuracy=0.5,maxEdits=2,minPrefix=1,maxInspections=5,minQueryLength=4,maxQueryFrequency=0.01}
   [junit4]   2> 18712 T74 oashc.SpellCheckComponent.inform No queryConverter defined, using default converter
   [junit4]   2> 18712 T74 oashc.QueryElevationComponent.inform Loading QueryElevation from: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/conf/elevate.xml
   [junit4]   2> 18746 T74 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 18746 T74 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 18747 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@f5b595[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 18747 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 18747 T75 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: default
   [junit4]   2> 18747 T75 oashc.SpellCheckComponent$SpellCheckerListener.newSearcher Loading spell index for spellchecker: wordbreak
   [junit4]   2> 18747 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@f5b595[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 18749 T64 oass.SolrDispatchFilter.init user.dir=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0
   [junit4]   2> 18749 T64 oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 18750 T64 oas.SolrJettyTestBase.createJetty Jetty Assigned Port#38679
   [junit4]   2> 18758 T64 oas.SolrTestCaseJ4.setUp ###Starting testCommitWithinOnAdd
   [junit4]   2> ASYNC  NEW_CORE C7 name=collection1 org.apache.solr.core.SolrCore@939295
   [junit4]   2> 19289 T70 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1480582325158805504)} 0 87
   [junit4]   2> 19337 T72 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 19338 T72 C7 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 19339 T72 C7 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 19340 T72 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 19341 T72 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 5
   [junit4]   2> 19349 T71 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=2 
   [junit4]   2> 19470 T70 C7 oass.ManagedIndexSchema.persistManagedSchema Upgraded to managed schema at /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-001/collection1/conf/managed-schema
   [junit4]   2> 19559 T70 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id3 (1480582325286731776)]} 0 198
   [junit4]   2> 19565 T72 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=1 
   [junit4]   2> 20059 T78 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 20193 T78 oass.SolrIndexSearcher.<init> Opening Searcher@1fb5bc0[collection1] main
   [junit4]   2> 20196 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1fb5bc0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C1)))}
   [junit4]   2> 20197 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 20197 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1fb5bc0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C1)))}
   [junit4]   2> 20197 T78 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 20607 T72 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=id:id3&wt=javabin&version=2} hits=1 status=0 QTime=35 
   [junit4]   2> 20628 T71 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id4 (1480582326603743232)]} 0 9
   [junit4]   2> 21127 T78 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 21157 T78 oass.SolrIndexSearcher.<init> Opening Searcher@1d4931b[collection1] main
   [junit4]   2> 21158 T78 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 21158 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1d4931b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C1) Uninverting(_1(6.0.0):C1)))}
   [junit4]   2> 21158 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 21158 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1d4931b[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(6.0.0):C1) Uninverting(_1(6.0.0):C1)))}
   [junit4]   2> 21633 T73 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=id:id4&wt=javabin&version=2} hits=1 status=0 QTime=1 
   [junit4]   2> 21634 T64 oas.SolrTestCaseJ4.tearDown ###Ending testCommitWithinOnAdd
   [junit4]   2> 21662 T64 oas.SolrTestCaseJ4.setUp ###Starting testStreamingRequest
   [junit4]   2> 21760 T70 C7 oass.SolrIndexSearcher.<init> Opening Searcher@1d05d1a[collection1] realtime
   [junit4]   2> 21762 T70 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1480582327701602304)} 0 95
   [junit4]   2> 34559 T77 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 34559 T77 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_1,generation=1}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_2,generation=2}
   [junit4]   2> 34560 T77 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 2
   [junit4]   2> 34560 T77 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222416 T72 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 222416 T64 oas.SolrTestCaseJ4.tearDown ###Ending testStreamingRequest
   [junit4]   2> 222416 T72 C7 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 222417 T72 C7 oass.SolrIndexSearcher.<init> Opening Searcher@129962[collection1] main
   [junit4]   2> 222418 T72 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222418 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@129962[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 222419 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 222419 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@129962[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 222426 T72 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 10
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSchemalessExampleTest -Dtests.method=testStreamingRequest -Dtests.seed=CD54FC8755960C32 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sv_SE -Dtests.timezone=Europe/Rome -Dtests.file.encoding=US-ASCII
   [junit4] ERROR    201s J0 | SolrSchemalessExampleTest.testStreamingRequest <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.SolrServerException: IOException occured when talking to server at: https://127.0.0.1:38679/solr/collection1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CD54FC8755960C32:ABD8489779DA761]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:585)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:215)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.request(HttpSolrServer.java:211)
   [junit4]    > 	at org.apache.solr.client.solrj.request.AbstractUpdateRequest.process(AbstractUpdateRequest.java:124)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:168)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrServer.commit(SolrServer.java:146)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrExampleTestsBase.testStreamingRequest(SolrExampleTestsBase.java:219)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: org.apache.http.NoHttpResponseException: The target server failed to respond
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:143)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultHttpResponseParser.parseHead(DefaultHttpResponseParser.java:57)
   [junit4]    > 	at org.apache.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:260)
   [junit4]    > 	at org.apache.http.impl.AbstractHttpClientConnection.receiveResponseHeader(AbstractHttpClientConnection.java:283)
   [junit4]    > 	at org.apache.http.impl.conn.DefaultClientConnection.receiveResponseHeader(DefaultClientConnection.java:251)
   [junit4]    > 	at org.apache.http.impl.conn.ManagedClientConnectionImpl.receiveResponseHeader(ManagedClientConnectionImpl.java:197)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.doReceiveResponse(HttpRequestExecutor.java:271)
   [junit4]    > 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:123)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.tryExecute(DefaultRequestDirector.java:682)
   [junit4]    > 	at org.apache.http.impl.client.DefaultRequestDirector.execute(DefaultRequestDirector.java:486)
   [junit4]    > 	at org.apache.http.impl.client.AbstractHttpClient.doExecute(AbstractHttpClient.java:863)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:106)
   [junit4]    > 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:57)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrServer.executeMethod(HttpSolrServer.java:466)
   [junit4]    > 	... 46 more
   [junit4]   2> 222474 T64 oas.SolrTestCaseJ4.setUp ###Starting testArbitraryJsonIndexing
   [junit4]   2> 222484 T73 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1480582538272440320)} 0 1
   [junit4]   2> 222487 T72 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 222488 T72 C7 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 222488 T72 C7 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 222489 T72 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222490 T72 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 3
   [junit4]   2> 222493 T70 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0 
   [junit4]   2> 222515 T71 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update/json/docs params={} {add=[abc1 (1480582538301800448), b35c0329-979e-4557-984b-c1cc258c3e46 (1480582538304946176)]} 0 18
   [junit4]   2> 222530 T70 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 222535 T70 C7 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_2,generation=2}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_3,generation=3}
   [junit4]   2> 222535 T70 C7 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 3
   [junit4]   2> 222537 T70 C7 oass.SolrIndexSearcher.<init> Opening Searcher@16e976a[collection1] main
   [junit4]   2> 222538 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@16e976a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.0.0):C2)))}
   [junit4]   2> 222538 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 222538 T70 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222538 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16e976a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_2(6.0.0):C2)))}
   [junit4]   2> 222539 T70 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 9
   [junit4]   2> 222543 T71 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=2 status=0 QTime=1 
   [junit4]   2> 222548 T64 oas.SolrTestCaseJ4.tearDown ###Ending testArbitraryJsonIndexing
   [junit4]   2> 222559 T64 oas.SolrTestCaseJ4.setUp ###Starting testAddDelete
   [junit4]   2> 222563 T73 C7 oass.SolrIndexSearcher.<init> Opening Searcher@8b7ef2[collection1] realtime
   [junit4]   2> 222564 T73 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1480582538355277824)} 0 3
   [junit4]   2> 222570 T72 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0 & 222 (1480582538361569280)]} 0 2
   [junit4]   2> 222574 T70 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 222629 T70 C7 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_3,generation=3}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_4,generation=4}
   [junit4]   2> 222629 T70 C7 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 4
   [junit4]   2> 222636 T70 C7 oass.SolrIndexSearcher.<init> Opening Searcher@1e43664[collection1] main
   [junit4]   2> 222637 T70 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222637 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1e43664[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(6.0.0):C1)))}
   [junit4]   2> 222637 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 222637 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1e43664[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_3(6.0.0):C1)))}
   [junit4]   2> 222638 T70 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 64
   [junit4]   2> 222642 T71 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0 
   [junit4]   2> 222646 T73 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {delete=[0 & 222 (-1480582538443358208)]} 0 1
   [junit4]   2> 222650 T72 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 222652 T72 C7 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_4,generation=4}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_5,generation=5}
   [junit4]   2> 222652 T72 C7 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 5
   [junit4]   2> 222653 T72 C7 oass.SolrIndexSearcher.<init> Opening Searcher@6a2209[collection1] main
   [junit4]   2> 222654 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@6a2209[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 222654 T72 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222654 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 222655 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@6a2209[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 222655 T72 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 5
   [junit4]   2> 222659 T70 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0 
   [junit4]   2> 222664 T71 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0 & 222 (1480582538461184000)]} 0 2
   [junit4]   2> 222667 T73 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 222671 T73 C7 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_5,generation=5}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_6,generation=6}
   [junit4]   2> 222671 T73 C7 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 6
   [junit4]   2> 222672 T73 C7 oass.SolrIndexSearcher.<init> Opening Searcher@1c3ba5c[collection1] main
   [junit4]   2> 222673 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1c3ba5c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.0.0):C1)))}
   [junit4]   2> 222674 T73 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222674 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 222674 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1c3ba5c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_4(6.0.0):C1)))}
   [junit4]   2> 222675 T73 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 8
   [junit4]   2> 222678 T72 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=1 status=0 QTime=0 
   [junit4]   2> 222684 T70 C7 oass.SolrIndexSearcher.<init> Opening Searcher@129c17f[collection1] realtime
   [junit4]   2> 222684 T70 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=id:"0\ \&\ 222" (-1480582538481106944)} 0 2
   [junit4]   2> 222688 T71 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 222688 T71 C7 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_6,generation=6}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_7,generation=7}
   [junit4]   2> 222689 T71 C7 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 7
   [junit4]   2> 222690 T71 C7 oass.SolrIndexSearcher.<init> Opening Searcher@16ebe1a[collection1] main
   [junit4]   2> 222691 T71 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222691 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@16ebe1a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 222692 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 222692 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@16ebe1a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 222693 T71 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 5
   [junit4]   2> 222700 T73 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0 
   [junit4]   2> 222706 T72 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[0 & 222 (1480582538505224192)]} 0 2
   [junit4]   2> 222712 T70 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[1 & 222 (1480582538511515648)]} 0 2
   [junit4]   2> 222716 T71 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[2 & 222 (1480582538516758528)]} 0 1
   [junit4]   2> 222720 T73 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 222774 T73 C7 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_7,generation=7}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_8,generation=8}
   [junit4]   2> 222774 T73 C7 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 8
   [junit4]   2> 222776 T73 C7 oass.SolrIndexSearcher.<init> Opening Searcher@9bb16e[collection1] main
   [junit4]   2> 222777 T73 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222777 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@9bb16e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(6.0.0):C3)))}
   [junit4]   2> 222778 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 222778 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@9bb16e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_5(6.0.0):C3)))}
   [junit4]   2> 222778 T73 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 58
   [junit4]   2> 222782 T72 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=3 status=0 QTime=0 
   [junit4]   2> 222788 T70 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {delete=[0 & 222 (-1480582538591207424), 1 & 222 (-1480582538591207425), 2 & 222 (-1480582538591207426)]} 0 2
   [junit4]   2> 222791 T71 C7 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 222793 T71 C7 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_8,generation=8}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_9,generation=9}
   [junit4]   2> 222793 T71 C7 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 9
   [junit4]   2> 222794 T71 C7 oass.SolrIndexSearcher.<init> Opening Searcher@b6d18f[collection1] main
   [junit4]   2> 222795 T71 C7 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222795 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@b6d18f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 222795 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 222796 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@b6d18f[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 222797 T71 C7 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 6
   [junit4]   2> 222800 T73 C7 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0 
   [junit4]   2> 222802 T64 oas.SolrTestCaseJ4.tearDown ###Ending testAddDelete
   [junit4]   2> 222841 T64 oas.SolrTestCaseJ4.setUp ###Starting testCommitWithinOnDelete
   [junit4]   2> ASYNC  NEW_CORE C8 name=collection1 org.apache.solr.core.SolrCore@939295
   [junit4]   2> 222845 T72 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {deleteByQuery=*:* (-1480582538650976256)} 0 1
   [junit4]   2> 222849 T71 C8 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 222849 T71 C8 oasu.DirectUpdateHandler2.commit No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 222850 T71 C8 oasc.SolrCore.openNewSearcher SolrIndexSearcher has not changed - not re-opening: org.apache.solr.search.SolrIndexSearcher
   [junit4]   2> 222851 T71 C8 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222851 T71 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 2
   [junit4]   2> 222854 T73 C8 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0 
   [junit4]   2> 222860 T70 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {add=[id3 (1480582538665656320)]} 0 2
   [junit4]   2> 222864 T72 C8 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 222868 T72 C8 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_9,generation=9}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_a,generation=10}
   [junit4]   2> 222869 T72 C8 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 10
   [junit4]   2> 222871 T72 C8 oass.SolrIndexSearcher.<init> Opening Searcher@2a8c2d[collection1] main
   [junit4]   2> 222872 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@2a8c2d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_6(6.0.0):C1)))}
   [junit4]   2> 222872 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 222873 T72 C8 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 222873 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@2a8c2d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_6(6.0.0):C1)))}
   [junit4]   2> 222873 T72 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} {commit=} 0 9
   [junit4]   2> 222878 T71 C8 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=id:id3&wt=javabin&version=2} hits=1 status=0 QTime=1 
   [junit4]   2> 222882 T73 C8 oasup.LogUpdateProcessor.finish [collection1] webapp=/solr path=/update params={wt=javabin&version=2} {delete=[id3 (-1480582538689773568)]} 0 1
   [junit4]   2> 222885 T70 C8 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=id:id3&wt=javabin&version=2} hits=1 status=0 QTime=0 
   [junit4]   2> 223140 T71 C8 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=id:id3&wt=javabin&version=2} hits=1 status=0 QTime=1 
   [junit4]   2> 223394 T73 C8 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=id:id3&wt=javabin&version=2} hits=1 status=0 QTime=1 
   [junit4]   2> 223648 T72 C8 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=id:id3&wt=javabin&version=2} hits=1 status=0 QTime=0 
   [junit4]   2> 223882 T78 oasu.DirectUpdateHandler2.commit start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=true,prepareCommit=false}
   [junit4]   2> 223883 T78 oass.SolrIndexSearcher.<init> Opening Searcher@1455193[collection1] main
   [junit4]   2> 223883 T78 oasu.DirectUpdateHandler2.commit end_commit_flush
   [junit4]   2> 223883 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener sending requests to Searcher@1455193[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 223884 T75 oasc.QuerySenderListener.newSearcher QuerySenderListener done.
   [junit4]   2> 223884 T75 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@1455193[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 223902 T70 C8 oasc.SolrCore.execute [collection1] webapp=/solr path=/select params={q=id:id3&wt=javabin&version=2} hits=0 status=0 QTime=0 
   [junit4]   2> 223903 T64 oas.SolrTestCaseJ4.tearDown ###Ending testCommitWithinOnDelete
   [junit4]   2> 223927 T64 oasc.CoreContainer.shutdown Shutting down CoreContainer instance=24366081
   [junit4]   2> 223928 T64 oasc.SolrCore.close [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@939295
   [junit4]   2> 223929 T64 oasu.DirectUpdateHandler2.close closing DirectUpdateHandler2{commits=16,autocommit maxTime=15000ms,autocommits=1,soft autocommits=3,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=10,cumulative_deletesById=5,cumulative_deletesByQuery=6,cumulative_errors=0,transaction_logs_total_size=1116,transaction_logs_total_number=10}
   [junit4]   2> 223930 T64 oasu.SolrCoreState.decrefSolrCoreState Closing SolrCoreState
   [junit4]   2> 223930 T64 oasu.DefaultSolrCoreState.closeIndexWriter SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 223930 T64 oasu.DefaultSolrCoreState.closeIndexWriter closing IndexWriter with IndexWriterCloser
   [junit4]   2> 223930 T64 C8 oasu.DirectUpdateHandler2.closeWriter Committing on IndexWriter close.
   [junit4]   2> 223931 T64 C8 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=2
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_a,generation=10}
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory(id=lucene-70f57e)),segFN=segments_b,generation=11}
   [junit4]   2> 223932 T64 C8 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 11
   [junit4]   2> 223935 T64 oasc.SolrCore.closeSearcher [collection1] Closing main searcher on request.
   [junit4]   2> 223936 T64 oasc.CachingDirectoryFactory.close Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 223936 T64 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-002 [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-002;done=false>>]
   [junit4]   2> 223936 T64 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-002
   [junit4]   2> 223937 T64 oasc.CachingDirectoryFactory.closeCacheValue looking to close /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-002/index [CachedDir<<refCount=0;path=/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-002/index;done=false>>]
   [junit4]   2> 223937 T64 oasc.CachingDirectoryFactory.close Closing directory: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001/tempDir-002/index
   [junit4]   2> 223938 T64 oejsh.ContextHandler.doStop stopped o.e.j.s.ServletContextHandler{/solr,null}
   [junit4]   2> 228918 T64 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-solrj/test/J0/temp/solr.client.solrj.SolrSchemalessExampleTest-CD54FC8755960C32-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene50): {}, docValues:{}, sim=DefaultSimilarity, locale=sv_SE, timezone=Europe/Rome
   [junit4]   2> NOTE: Linux 3.13.0-36-generic i386/Oracle Corporation 1.8.0_40-ea (32-bit)/cpus=8,threads=1,free=66434152,total=103809024
   [junit4]   2> NOTE: All tests run in this JVM: [TestCoreAdmin, AnlysisResponseBaseTest, JettyWebappTest, TestJavaBinCodec, TestDocumentObjectBinder, SolrSchemalessExampleTest]
   [junit4] Completed on J0 in 220.66s, 5 tests, 1 error <<< FAILURES!

[...truncated 109 lines...]
BUILD FAILED
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:524: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:472: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:61: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/extra-targets.xml:39: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:202: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:496: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1359: The following error occurred while executing this line:
/mnt/ssd/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:961: There were test failures: 53 suites, 314 tests, 1 error

Total time: 109 minutes 17 seconds
Build step 'Invoke Ant' marked build as failure
[description-setter] Description set: Java: 32bit/jdk1.8.0_40-ea-b04 -server -XX:+UseG1GC
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any