You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2015/05/25 08:31:53 UTC

[JENKINS] Lucene-Solr-Tests-5.2-Java7 - Build # 5 - Failure

Build: https://builds.apache.org/job/Lucene-Solr-Tests-5.2-Java7/5/

2 tests failed.
REGRESSION:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
commitWithin did not work on node: http://127.0.0.1:53712/dm/collection1 expected:<68> but was:<67>

Stack Trace:
java.lang.AssertionError: commitWithin did not work on node: http://127.0.0.1:53712/dm/collection1 expected:<68> but was:<67>
	at __randomizedtesting.SeedInfo.seed([104FB88EF14E2A84:981B87545FB2477C]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:344)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.HttpPartitionTest

Error Message:
Some resources were not closed, shutdown, or released.

Stack Trace:
java.lang.AssertionError: Some resources were not closed, shutdown, or released.
	at __randomizedtesting.SeedInfo.seed([104FB88EF14E2A84]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:234)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:799)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 9387 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/init-core-data-001
   [junit4]   2> 10195 T21 oas.BaseDistributedSearchTestCase.initHostContext Setting hostContext system property: /
   [junit4]   2> 10219 T21 oasc.ZkTestServer.run STARTING ZK TEST SERVER
   [junit4]   2> 10223 T22 oasc.ZkTestServer$2$1.setClientPort client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 10223 T22 oasc.ZkTestServer$ZKServerMain.runFromConfig Starting server
   [junit4]   2> 10322 T21 oasc.ZkTestServer.run start zk server on port:44111
   [junit4]   2> 10352 T21 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 10427 T21 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 10470 T29 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@2934fa09 name:ZooKeeperConnection Watcher:127.0.0.1:44111 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 10471 T21 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 10472 T21 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 10474 T21 oascc.SolrZkClient.makePath makePath: /solr
   [junit4]   2> 10508 T21 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 10511 T21 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 10514 T32 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@4ca355d0 name:ZooKeeperConnection Watcher:127.0.0.1:44111/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 10514 T21 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 10515 T21 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 10521 T21 oascc.SolrZkClient.makePath makePath: /collections/collection1
   [junit4]   2> 10527 T21 oascc.SolrZkClient.makePath makePath: /collections/collection1/shards
   [junit4]   2> 10535 T21 oascc.SolrZkClient.makePath makePath: /collections/control_collection
   [junit4]   2> 10538 T21 oascc.SolrZkClient.makePath makePath: /collections/control_collection/shards
   [junit4]   2> 10543 T21 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 10560 T21 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 10568 T21 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 10569 T21 oascc.SolrZkClient.makePath makePath: /configs/conf1/schema.xml
   [junit4]   2> 10574 T21 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 10575 T21 oascc.SolrZkClient.makePath makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 10580 T21 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 10580 T21 oascc.SolrZkClient.makePath makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 10585 T21 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 10585 T21 oascc.SolrZkClient.makePath makePath: /configs/conf1/protwords.txt
   [junit4]   2> 10597 T21 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 10597 T21 oascc.SolrZkClient.makePath makePath: /configs/conf1/currency.xml
   [junit4]   2> 10601 T21 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 10602 T21 oascc.SolrZkClient.makePath makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 10608 T21 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 10608 T21 oascc.SolrZkClient.makePath makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 10613 T21 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 10614 T21 oascc.SolrZkClient.makePath makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 10617 T21 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 10618 T21 oascc.SolrZkClient.makePath makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 10623 T21 oasc.AbstractZkTestCase.putConfig put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 10623 T21 oascc.SolrZkClient.makePath makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 11957 T21 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores/collection1
   [junit4]   2> 12000 T21 oejul.Log.initialized Logging initialized @13742ms
   [junit4]   2> 12168 T21 oejs.Server.doStart jetty-9.2.10.v20150310
   [junit4]   2> 12261 T21 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@1d6b6e76{/,null,AVAILABLE}
   [junit4]   2> 12281 T21 oejs.AbstractConnector.doStart Started ServerConnector@20fedcfd{HTTP/1.1}{127.0.0.1:58923}
   [junit4]   2> 12281 T21 oejs.Server.doStart Started @14024ms
   [junit4]   2> 12282 T21 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostPort=36763, hostContext=/, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/tempDir-001/control/data, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores}
   [junit4]   2> 12288 T21 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4dfd245f
   [junit4]   2> 12289 T21 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/'
   [junit4]   2> 12311 T21 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/solr.xml
   [junit4]   2> 12336 T21 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores
   [junit4]   2> 12337 T21 oasc.CoreContainer.<init> New CoreContainer 2007157670
   [junit4]   2> 12337 T21 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/]
   [junit4]   2> 12338 T21 oasc.CoreContainer.load loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/lib
   [junit4]   2> 12342 T21 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/lib).
   [junit4]   2> 12363 T21 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 12365 T21 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 12366 T21 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 12367 T21 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 12367 T21 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 12368 T21 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44111/solr
   [junit4]   2> 12382 T21 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 12383 T21 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 12384 T21 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 12390 T47 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@7e7f3129 name:ZooKeeperConnection Watcher:127.0.0.1:44111 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 12391 T21 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 12392 T21 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 12411 T21 n:127.0.0.1:36763_ oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 12413 T50 n:127.0.0.1:36763_ oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@13f0d199 name:ZooKeeperConnection Watcher:127.0.0.1:44111/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 12413 T21 n:127.0.0.1:36763_ oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 12426 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /overseer/queue
   [junit4]   2> 12436 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /overseer/collection-queue-work
   [junit4]   2> 12442 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-running
   [junit4]   2> 12461 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-completed
   [junit4]   2> 12466 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /overseer/collection-map-failure
   [junit4]   2> 12478 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /live_nodes
   [junit4]   2> 12483 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /aliases.json
   [junit4]   2> 12487 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /clusterstate.json
   [junit4]   2> 12493 T21 n:127.0.0.1:36763_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36763_
   [junit4]   2> 12497 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:36763_
   [junit4]   2> 12502 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /overseer_elect
   [junit4]   2> 12508 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /overseer_elect/election
   [junit4]   2> 12512 T21 n:127.0.0.1:36763_ oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 12526 T21 n:127.0.0.1:36763_ oasc.OverseerElectionContext.runLeaderProcess I am going to be the leader 127.0.0.1:36763_
   [junit4]   2> 12526 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /overseer_elect/leader
   [junit4]   2> 12533 T21 n:127.0.0.1:36763_ oasc.Overseer.start Overseer (id=93882527088902147-127.0.0.1:36763_-n_0000000000) starting
   [junit4]   2> 12545 T21 n:127.0.0.1:36763_ oascc.SolrZkClient.makePath makePath: /overseer/queue-work
   [junit4]   2> 12572 T21 n:127.0.0.1:36763_ oasc.OverseerAutoReplicaFailoverThread.<init> Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 12578 T52 n:127.0.0.1:36763_ oasc.OverseerCollectionProcessor.run Process current queue of collection creations
   [junit4]   2> 12585 T21 n:127.0.0.1:36763_ oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 12590 T51 n:127.0.0.1:36763_ oasc.Overseer$ClusterStateUpdater.run Starting to work on the main queue
   [junit4]   2> 12608 T21 n:127.0.0.1:36763_ oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
   [junit4]   2> 12610 T21 n:127.0.0.1:36763_ oasc.CoreContainer.intializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 12611 T21 n:127.0.0.1:36763_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores
   [junit4]   2> 12616 T21 n:127.0.0.1:36763_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {dataDir=data/, name=collection1, loadOnStartup=true, collection=control_collection, schema=schema.xml, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores/collection1/, coreNodeName=, config=solrconfig.xml, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores/collection1, shard=, transient=false}
   [junit4]   2> 12616 T21 n:127.0.0.1:36763_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores/collection1/
   [junit4]   2> 12617 T21 n:127.0.0.1:36763_ oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 12620 T54 n:127.0.0.1:36763_ c:control_collection x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=control_collection
   [junit4]   2> 12620 T54 n:127.0.0.1:36763_ c:control_collection x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 12627 T50 n:127.0.0.1:36763_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 12628 T54 n:127.0.0.1:36763_ oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 12631 T51 n:127.0.0.1:36763_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "node_name":"127.0.0.1:36763_",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:36763",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "roles":null} current state version: 0
   [junit4]   2> 12642 T51 n:127.0.0.1:36763_ oasco.ReplicaMutator.updateState Update state numShards=1 message={
   [junit4]   2> 	  "node_name":"127.0.0.1:36763_",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:36763",
   [junit4]   2> 	  "numShards":"1",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "roles":null}
   [junit4]   2> 12644 T51 n:127.0.0.1:36763_ oasco.ClusterStateMutator.createCollection building a new cName: control_collection
   [junit4]   2> 12654 T51 n:127.0.0.1:36763_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 12662 T50 n:127.0.0.1:36763_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 13628 T54 n:127.0.0.1:36763_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 13629 T54 n:127.0.0.1:36763_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:control_collection
   [junit4]   2> 13631 T54 n:127.0.0.1:36763_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 13631 T54 n:127.0.0.1:36763_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 13633 T54 n:127.0.0.1:36763_ oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 13634 T54 n:127.0.0.1:36763_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores/collection1/'
   [junit4]   2> 13657 T54 n:127.0.0.1:36763_ oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 13673 T54 n:127.0.0.1:36763_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 13691 T54 n:127.0.0.1:36763_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
   [junit4]   2> 13727 T54 n:127.0.0.1:36763_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 13729 T54 n:127.0.0.1:36763_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 13768 T54 n:127.0.0.1:36763_ oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 14092 T54 n:127.0.0.1:36763_ oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 14109 T54 n:127.0.0.1:36763_ oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 14121 T54 n:127.0.0.1:36763_ oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 14171 T54 n:127.0.0.1:36763_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 14176 T54 n:127.0.0.1:36763_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 14181 T54 n:127.0.0.1:36763_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 14183 T54 n:127.0.0.1:36763_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 14183 T54 n:127.0.0.1:36763_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 14184 T54 n:127.0.0.1:36763_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 14185 T54 n:127.0.0.1:36763_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 14186 T54 n:127.0.0.1:36763_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 14186 T54 n:127.0.0.1:36763_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 14187 T54 n:127.0.0.1:36763_ x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 14187 T54 n:127.0.0.1:36763_ x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 14188 T54 n:127.0.0.1:36763_ x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@24a494d2
   [junit4]   2> 14211 T54 n:127.0.0.1:36763_ x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores/collection1/data
   [junit4]   2> 14212 T54 n:127.0.0.1:36763_ x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores/collection1/data/index/
   [junit4]   2> 14212 T54 n:127.0.0.1:36763_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 14213 T54 n:127.0.0.1:36763_ x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/control-001/cores/collection1/data/index
   [junit4]   2> 14213 T54 n:127.0.0.1:36763_ x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2812317995446211]
   [junit4]   2> 14215 T54 n:127.0.0.1:36763_ x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@65821586 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f53447a),segFN=segments_1,generation=1}
   [junit4]   2> 14215 T54 n:127.0.0.1:36763_ x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 14226 T54 n:127.0.0.1:36763_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 14237 T54 n:127.0.0.1:36763_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 14237 T54 n:127.0.0.1:36763_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 14238 T54 n:127.0.0.1:36763_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 14238 T54 n:127.0.0.1:36763_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 14238 T54 n:127.0.0.1:36763_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 14239 T54 n:127.0.0.1:36763_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 14240 T54 n:127.0.0.1:36763_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 14240 T54 n:127.0.0.1:36763_ x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 14243 T54 n:127.0.0.1:36763_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 14247 T54 n:127.0.0.1:36763_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 14249 T54 n:127.0.0.1:36763_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 14252 T54 n:127.0.0.1:36763_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 14267 T54 n:127.0.0.1:36763_ x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/properties,/update/json/docs,/admin/system,/admin/logging,/update,/schema,/admin/segments,/replication,/get,/update/json,/update/csv,/admin/ping,/admin/luke,/config,/admin/file,/admin/mbeans,/admin/plugins,standard,/admin/threads
   [junit4]   2> 14269 T54 n:127.0.0.1:36763_ x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 14270 T54 n:127.0.0.1:36763_ x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 14271 T54 n:127.0.0.1:36763_ x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 14272 T54 n:127.0.0.1:36763_ x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 14272 T54 n:127.0.0.1:36763_ x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 14274 T54 n:127.0.0.1:36763_ x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=63.88671875, floorSegmentMB=0.8017578125, forceMergeDeletesPctAllowed=15.199363767909846, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.36720031117733776
   [junit4]   2> 14275 T54 n:127.0.0.1:36763_ x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@65821586 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3f53447a),segFN=segments_1,generation=1}
   [junit4]   2> 14275 T54 n:127.0.0.1:36763_ x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 14276 T54 n:127.0.0.1:36763_ x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@148195ab[collection1] main
   [junit4]   2> 14277 T54 n:127.0.0.1:36763_ x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/control_collection
   [junit4]   2> 14279 T54 n:127.0.0.1:36763_ x:collection1 oascc.ZkStateReader.readConfigName path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 14279 T54 n:127.0.0.1:36763_ x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 14283 T54 n:127.0.0.1:36763_ x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 14283 T54 n:127.0.0.1:36763_ x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 14284 T54 n:127.0.0.1:36763_ x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 14285 T54 n:127.0.0.1:36763_ x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 14286 T54 n:127.0.0.1:36763_ x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 14286 T54 n:127.0.0.1:36763_ x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 14286 T54 n:127.0.0.1:36763_ x:collection1 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 14290 T54 n:127.0.0.1:36763_ x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
   [junit4]   2> 14294 T55 n:127.0.0.1:36763_ x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@148195ab[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 14295 T54 n:127.0.0.1:36763_ x:collection1 oasu.UpdateLog.onFirstSearcher On first searcher opened, looking up max value of version field
   [junit4]   2> 14296 T54 n:127.0.0.1:36763_ x:collection1 oasu.VersionInfo.getMaxVersionFromIndex Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 14296 T54 n:127.0.0.1:36763_ x:collection1 oasu.VersionInfo.getMaxVersionFromIndex No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 14297 T54 n:127.0.0.1:36763_ x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Could not find max version in index or recent updates, using new clock 1502120437608349696
   [junit4]   2> 14298 T54 n:127.0.0.1:36763_ x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Took 2 ms to seed version buckets with highest version 1502120437608349696
   [junit4]   2> 14299 T54 n:127.0.0.1:36763_ x:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 14301 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:36763 collection:control_collection shard:shard1
   [junit4]   2> 14301 T21 n:127.0.0.1:36763_ oass.SolrDispatchFilter.init user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2
   [junit4]   2> 14301 T21 n:127.0.0.1:36763_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 14309 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 14321 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 14324 T50 n:127.0.0.1:36763_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 14326 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 14326 T51 n:127.0.0.1:36763_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection"} current state version: 1
   [junit4]   2> 14326 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C3 name=collection1 org.apache.solr.core.SolrCore@34182bd5 url=http://127.0.0.1:36763/collection1 node=127.0.0.1:36763_ C3_STATE=coll:control_collection core:collection1 props:{node_name=127.0.0.1:36763_, base_url=http://127.0.0.1:36763, core=collection1, state=down}
   [junit4]   2> 14328 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 C3 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:36763/collection1/
   [junit4]   2> 14329 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 C3 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 14329 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 C3 oasc.SyncStrategy.syncToMe http://127.0.0.1:36763/collection1/ has no replicas
   [junit4]   2> 14329 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:36763/collection1/ shard1
   [junit4]   2> 14331 T50 n:127.0.0.1:36763_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 14331 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 14345 T21 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 14346 T21 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 14349 T62 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@76fe1a35 name:ZooKeeperConnection Watcher:127.0.0.1:44111/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 14349 T21 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 14350 T21 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 14351 T21 oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 14353 T50 n:127.0.0.1:36763_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 14356 T51 n:127.0.0.1:36763_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:36763",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 2
   [junit4]   2> 14360 T21 oasc.ChaosMonkey.monkeyLog monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 14463 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 14463 T50 n:127.0.0.1:36763_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 14507 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:36763/collection1/ and leader is http://127.0.0.1:36763/collection1/
   [junit4]   2> 14507 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:36763
   [junit4]   2> 14508 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 14508 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=control_collection
   [junit4]   2> 14508 T58 n:127.0.0.1:36763_ c:control_collection s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 14511 T50 n:127.0.0.1:36763_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 14513 T51 n:127.0.0.1:36763_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "node_name":"127.0.0.1:36763_",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:36763",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "roles":null} current state version: 3
   [junit4]   2> 14515 T51 n:127.0.0.1:36763_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "node_name":"127.0.0.1:36763_",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:36763",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"control_collection",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "roles":null}
   [junit4]   2> 14623 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 14624 T50 n:127.0.0.1:36763_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 14706 T21 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores/collection1
   [junit4]   2> 14707 T21 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001
   [junit4]   2> 14709 T21 oejs.Server.doStart jetty-9.2.10.v20150310
   [junit4]   2> 14716 T21 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@5c72deee{/,null,AVAILABLE}
   [junit4]   2> 14717 T21 oejs.AbstractConnector.doStart Started ServerConnector@55c2e08a{HTTP/1.1}{127.0.0.1:49560}
   [junit4]   2> 14717 T21 oejs.Server.doStart Started @16460ms
   [junit4]   2> 14717 T21 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {solrconfig=solrconfig.xml, hostPort=57985, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores, hostContext=/, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/tempDir-001/jetty1}
   [junit4]   2> 14719 T21 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4dfd245f
   [junit4]   2> 14719 T21 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/'
   [junit4]   2> 14736 T21 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/solr.xml
   [junit4]   2> 14755 T21 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores
   [junit4]   2> 14755 T21 oasc.CoreContainer.<init> New CoreContainer 2094190678
   [junit4]   2> 14755 T21 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/]
   [junit4]   2> 14756 T21 oasc.CoreContainer.load loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/lib
   [junit4]   2> 14756 T21 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/lib).
   [junit4]   2> 14775 T21 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 14776 T21 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 14777 T21 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 14778 T21 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 14778 T21 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 14779 T21 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44111/solr
   [junit4]   2> 14779 T21 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 14779 T21 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 14780 T21 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 14784 T76 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@25e83bc name:ZooKeeperConnection Watcher:127.0.0.1:44111 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 14784 T21 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 14785 T21 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 14794 T21 n:127.0.0.1:57985_ oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 14796 T79 n:127.0.0.1:57985_ oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@1d33f970 name:ZooKeeperConnection Watcher:127.0.0.1:44111/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 14797 T21 n:127.0.0.1:57985_ oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 14818 T21 n:127.0.0.1:57985_ oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 15826 T21 n:127.0.0.1:57985_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:57985_
   [junit4]   2> 15828 T21 n:127.0.0.1:57985_ oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:57985_
   [junit4]   2> 15833 T21 n:127.0.0.1:57985_ oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 15838 T21 n:127.0.0.1:57985_ oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
   [junit4]   2> 15839 T21 n:127.0.0.1:57985_ oasc.CoreContainer.intializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 15840 T21 n:127.0.0.1:57985_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores
   [junit4]   2> 15842 T21 n:127.0.0.1:57985_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {loadOnStartup=true, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores/collection1, dataDir=data/, shard=, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores/collection1/, coreNodeName=, config=solrconfig.xml, schema=schema.xml, transient=false, name=collection1, collection=collection1}
   [junit4]   2> 15842 T21 n:127.0.0.1:57985_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores/collection1/
   [junit4]   2> 15843 T21 n:127.0.0.1:57985_ oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 15844 T80 n:127.0.0.1:57985_ c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 15844 T80 n:127.0.0.1:57985_ c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 15846 T50 n:127.0.0.1:36763_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 15846 T80 n:127.0.0.1:57985_ oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 15848 T51 n:127.0.0.1:36763_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "node_name":"127.0.0.1:57985_",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:57985",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "roles":null} current state version: 4
   [junit4]   2> 15849 T51 n:127.0.0.1:36763_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "node_name":"127.0.0.1:57985_",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:57985",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "roles":null}
   [junit4]   2> 15849 T51 n:127.0.0.1:36763_ oasco.ClusterStateMutator.createCollection building a new cName: collection1
   [junit4]   2> 15850 T51 n:127.0.0.1:36763_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard1
   [junit4]   2> 15956 T50 n:127.0.0.1:36763_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 15957 T79 n:127.0.0.1:57985_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 15956 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 16847 T80 n:127.0.0.1:57985_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 16848 T80 n:127.0.0.1:57985_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 16850 T80 n:127.0.0.1:57985_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 16851 T80 n:127.0.0.1:57985_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 16853 T80 n:127.0.0.1:57985_ oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 16854 T80 n:127.0.0.1:57985_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores/collection1/'
   [junit4]   2> 16874 T80 n:127.0.0.1:57985_ oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 16884 T80 n:127.0.0.1:57985_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 16901 T80 n:127.0.0.1:57985_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
   [junit4]   2> 16934 T80 n:127.0.0.1:57985_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 16937 T80 n:127.0.0.1:57985_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 16957 T80 n:127.0.0.1:57985_ oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 17262 T80 n:127.0.0.1:57985_ oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 17279 T80 n:127.0.0.1:57985_ oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 17282 T80 n:127.0.0.1:57985_ oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 17321 T80 n:127.0.0.1:57985_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 17327 T80 n:127.0.0.1:57985_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 17332 T80 n:127.0.0.1:57985_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 17337 T80 n:127.0.0.1:57985_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 17338 T80 n:127.0.0.1:57985_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 17338 T80 n:127.0.0.1:57985_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 17340 T80 n:127.0.0.1:57985_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 17340 T80 n:127.0.0.1:57985_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 17340 T80 n:127.0.0.1:57985_ oasc.CoreContainer.create Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 17342 T80 n:127.0.0.1:57985_ x:collection1 oasc.SolrCore.initDirectoryFactory org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 17342 T80 n:127.0.0.1:57985_ x:collection1 oasc.SolrCore.<init> [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 17343 T80 n:127.0.0.1:57985_ x:collection1 oasc.JmxMonitoredMap.<init> JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@24a494d2
   [junit4]   2> 17345 T80 n:127.0.0.1:57985_ x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores/collection1/data
   [junit4]   2> 17346 T80 n:127.0.0.1:57985_ x:collection1 oasc.SolrCore.getNewIndexDir New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores/collection1/data/index/
   [junit4]   2> 17346 T80 n:127.0.0.1:57985_ x:collection1 oasc.SolrCore.initIndex WARN [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 17347 T80 n:127.0.0.1:57985_ x:collection1 oasc.CachingDirectoryFactory.get return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-1-001/cores/collection1/data/index
   [junit4]   2> 17348 T80 n:127.0.0.1:57985_ x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2812317995446211]
   [junit4]   2> 17350 T80 n:127.0.0.1:57985_ x:collection1 oasc.SolrDeletionPolicy.onCommit SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1da472e5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@17732797),segFN=segments_1,generation=1}
   [junit4]   2> 17351 T80 n:127.0.0.1:57985_ x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 17365 T80 n:127.0.0.1:57985_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 17365 T80 n:127.0.0.1:57985_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 17366 T80 n:127.0.0.1:57985_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 17366 T80 n:127.0.0.1:57985_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 17367 T80 n:127.0.0.1:57985_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 17368 T80 n:127.0.0.1:57985_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 17368 T80 n:127.0.0.1:57985_ x:collection1 oasup.UpdateRequestProcessorChain.init creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 17369 T80 n:127.0.0.1:57985_ x:collection1 oasup.UpdateRequestProcessorChain.init inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 17369 T80 n:127.0.0.1:57985_ x:collection1 oasc.SolrCore.loadUpdateProcessorChains no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 17373 T80 n:127.0.0.1:57985_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 17376 T80 n:127.0.0.1:57985_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 17380 T80 n:127.0.0.1:57985_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 17384 T80 n:127.0.0.1:57985_ x:collection1 oashl.XMLLoader.init xsltCacheLifetimeSeconds=60
   [junit4]   2> 17419 T80 n:127.0.0.1:57985_ x:collection1 oasc.RequestHandlers.initHandlersFromConfig Registered paths: /admin/properties,/update/json/docs,/admin/system,/admin/logging,/update,/schema,/admin/segments,/replication,/get,/update/json,/update/csv,/admin/ping,/admin/luke,/config,/admin/file,/admin/mbeans,/admin/plugins,standard,/admin/threads
   [junit4]   2> 17421 T80 n:127.0.0.1:57985_ x:collection1 oasc.SolrCore.initStatsCache Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 17422 T80 n:127.0.0.1:57985_ x:collection1 oasu.UpdateHandler.<init> Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 17422 T80 n:127.0.0.1:57985_ x:collection1 oasu.UpdateLog.init Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 17423 T80 n:127.0.0.1:57985_ x:collection1 oasu.CommitTracker.<init> Hard AutoCommit: disabled
   [junit4]   2> 17424 T80 n:127.0.0.1:57985_ x:collection1 oasu.CommitTracker.<init> Soft AutoCommit: disabled
   [junit4]   2> 17426 T80 n:127.0.0.1:57985_ x:collection1 oasu.RandomMergePolicy.<init> RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=17, maxMergeAtOnceExplicit=29, maxMergedSegmentMB=63.88671875, floorSegmentMB=0.8017578125, forceMergeDeletesPctAllowed=15.199363767909846, segmentsPerTier=46.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.36720031117733776
   [junit4]   2> 17427 T80 n:127.0.0.1:57985_ x:collection1 oasc.SolrDeletionPolicy.onInit SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 		commit{dir=MockDirectoryWrapper(RAMDirectory@1da472e5 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@17732797),segFN=segments_1,generation=1}
   [junit4]   2> 17427 T80 n:127.0.0.1:57985_ x:collection1 oasc.SolrDeletionPolicy.updateCommits newest commit generation = 1
   [junit4]   2> 17427 T80 n:127.0.0.1:57985_ x:collection1 oass.SolrIndexSearcher.<init> Opening Searcher@39388b6e[collection1] main
   [junit4]   2> 17428 T80 n:127.0.0.1:57985_ x:collection1 oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 17430 T80 n:127.0.0.1:57985_ x:collection1 oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 17430 T80 n:127.0.0.1:57985_ x:collection1 oasr.ManagedResourceStorage.newStorageIO Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 17435 T80 n:127.0.0.1:57985_ x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.configure Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 17435 T80 n:127.0.0.1:57985_ x:collection1 oasr.RestManager.init Initializing RestManager with initArgs: {}
   [junit4]   2> 17435 T80 n:127.0.0.1:57985_ x:collection1 oasr.ManagedResourceStorage.load Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 17436 T80 n:127.0.0.1:57985_ x:collection1 oasr.ManagedResourceStorage$ZooKeeperStorageIO.openInputStream No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 17437 T80 n:127.0.0.1:57985_ x:collection1 oasr.ManagedResourceStorage.load Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 17437 T80 n:127.0.0.1:57985_ x:collection1 oasr.RestManager.init Initializing 0 registered ManagedResources
   [junit4]   2> 17437 T80 n:127.0.0.1:57985_ x:collection1 oash.ReplicationHandler.inform Commits will be reserved for  10000
   [junit4]   2> 17441 T81 n:127.0.0.1:57985_ x:collection1 oasc.SolrCore.registerSearcher [collection1] Registered new searcher Searcher@39388b6e[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 17442 T80 n:127.0.0.1:57985_ x:collection1 oasc.ZkController.getConfDirListeners watch zkdir /configs/conf1
   [junit4]   2> 17444 T80 n:127.0.0.1:57985_ x:collection1 oasu.UpdateLog.onFirstSearcher On first searcher opened, looking up max value of version field
   [junit4]   2> 17444 T80 n:127.0.0.1:57985_ x:collection1 oasu.VersionInfo.getMaxVersionFromIndex Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 17445 T80 n:127.0.0.1:57985_ x:collection1 oasu.VersionInfo.getMaxVersionFromIndex No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 17445 T80 n:127.0.0.1:57985_ x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Could not find max version in index or recent updates, using new clock 1502120440909266944
   [junit4]   2> 17447 T80 n:127.0.0.1:57985_ x:collection1 oasu.UpdateLog.seedBucketsWithHighestVersion Took 3 ms to seed version buckets with highest version 1502120440909266944
   [junit4]   2> 17447 T80 n:127.0.0.1:57985_ x:collection1 oasc.CoreContainer.registerCore registering core: collection1
   [junit4]   2> 17448 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oasc.ZkController.register Register replica - core:collection1 address:http://127.0.0.1:57985 collection:collection1 shard:shard1
   [junit4]   2> 17449 T21 n:127.0.0.1:57985_ oass.SolrDispatchFilter.init user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2
   [junit4]   2> 17449 T21 n:127.0.0.1:57985_ oass.SolrDispatchFilter.init SolrDispatchFilter.init() done
   [junit4]   2> 17450 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leader_elect/shard1/election
   [junit4]   2> 17459 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess Running the leader process for shard shard1
   [junit4]   2> 17462 T50 n:127.0.0.1:36763_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 17463 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.waitForReplicasToComeUp Enough replicas found to continue.
   [junit4]   2> 17464 T51 n:127.0.0.1:36763_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1"} current state version: 5
   [junit4]   2> 17464 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I may be the new leader - try and sync
   [junit4]   2> ASYNC  NEW_CORE C4 name=collection1 org.apache.solr.core.SolrCore@49f65cd url=http://127.0.0.1:57985/collection1 node=127.0.0.1:57985_ C4_STATE=coll:collection1 core:collection1 props:{node_name=127.0.0.1:57985_, base_url=http://127.0.0.1:57985, core=collection1, state=down}
   [junit4]   2> 17464 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 C4 oasc.SyncStrategy.sync Sync replicas to http://127.0.0.1:57985/collection1/
   [junit4]   2> 17471 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 C4 oasc.SyncStrategy.syncReplicas Sync Success - now sync replicas to me
   [junit4]   2> 17471 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 C4 oasc.SyncStrategy.syncToMe http://127.0.0.1:57985/collection1/ has no replicas
   [junit4]   2> 17471 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oasc.ShardLeaderElectionContext.runLeaderProcess I am the new leader: http://127.0.0.1:57985/collection1/ shard1
   [junit4]   2> 17472 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oascc.SolrZkClient.makePath makePath: /collections/collection1/leaders/shard1
   [junit4]   2> 17473 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17473 T79 n:127.0.0.1:57985_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17473 T50 n:127.0.0.1:36763_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17486 T50 n:127.0.0.1:36763_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 17488 T51 n:127.0.0.1:36763_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "operation":"leader",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:57985",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "state":"active"} current state version: 6
   [junit4]   2> 17594 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17594 T50 n:127.0.0.1:36763_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17595 T79 n:127.0.0.1:57985_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17638 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oasc.ZkController.register We are http://127.0.0.1:57985/collection1/ and leader is http://127.0.0.1:57985/collection1/
   [junit4]   2> 17638 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oasc.ZkController.register No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:57985
   [junit4]   2> 17639 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oasc.ZkController.checkRecovery I am the leader, no recovery necessary
   [junit4]   2> 17639 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=active collection=collection1
   [junit4]   2> 17639 T84 n:127.0.0.1:57985_ c:collection1 s:shard1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 17642 T50 n:127.0.0.1:36763_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 17655 T51 n:127.0.0.1:36763_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "node_name":"127.0.0.1:57985_",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:57985",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "roles":null} current state version: 7
   [junit4]   2> 17657 T51 n:127.0.0.1:36763_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "core_node_name":"core_node1",
   [junit4]   2> 	  "node_name":"127.0.0.1:57985_",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:57985",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "shard":"shard1",
   [junit4]   2> 	  "state":"active",
   [junit4]   2> 	  "roles":null}
   [junit4]   2> 17765 T79 n:127.0.0.1:57985_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17765 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17765 T50 n:127.0.0.1:36763_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 17804 T21 oas.SolrTestCaseJ4.writeCoreProperties Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/cores/collection1
   [junit4]   2> 17806 T21 oasc.AbstractFullDistribZkTestBase.createJettys create jetty 2 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001
   [junit4]   2> 17807 T21 oejs.Server.doStart jetty-9.2.10.v20150310
   [junit4]   2> 17810 T21 oejsh.ContextHandler.doStart Started o.e.j.s.ServletContextHandler@5e7a2419{/,null,AVAILABLE}
   [junit4]   2> 17811 T21 oejs.AbstractConnector.doStart Started ServerConnector@24d815c4{HTTP/1.1}{127.0.0.1:34345}
   [junit4]   2> 17811 T21 oejs.Server.doStart Started @19554ms
   [junit4]   2> 17811 T21 oascse.JettySolrRunner$1.lifeCycleStarted Jetty properties: {hostContext=/, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/tempDir-001/jetty2, hostPort=53715, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/cores, solrconfig=solrconfig.xml}
   [junit4]   2> 17812 T21 oass.SolrDispatchFilter.init SolrDispatchFilter.init()sun.misc.Launcher$AppClassLoader@4dfd245f
   [junit4]   2> 17813 T21 oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/'
   [junit4]   2> 17829 T21 oasc.SolrXmlConfig.fromFile Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/solr.xml
   [junit4]   2> 17846 T21 oasc.CorePropertiesLocator.<init> Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/cores
   [junit4]   2> 17846 T21 oasc.CoreContainer.<init> New CoreContainer 1152155003
   [junit4]   2> 17847 T21 oasc.CoreContainer.load Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/]
   [junit4]   2> 17847 T21 oasc.CoreContainer.load loading shared library: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/lib
   [junit4]   2> 17848 T21 oasc.SolrResourceLoader.addToClassLoader WARN Can't find (or read) directory to add to classloader: lib (resolved as: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/lib).
   [junit4]   2> 17856 T21 oashc.HttpShardHandlerFactory.init created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 17858 T21 oasu.UpdateShardHandler.<init> Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 17859 T21 oasl.LogWatcher.createWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 17859 T21 oasl.LogWatcher.newRegisteredLogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 17860 T21 oasc.CoreContainer.load Node Name: 127.0.0.1
   [junit4]   2> 17860 T21 oasc.ZkContainer.initZooKeeper Zookeeper client=127.0.0.1:44111/solr
   [junit4]   2> 17860 T21 oasc.ZkController.checkChrootPath zkHost includes chroot
   [junit4]   2> 17861 T21 oascc.SolrZkClient.createZkCredentialsToAddAutomatically Using default ZkCredentialsProvider
   [junit4]   2> 17862 T21 oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 17864 T99 oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@12326d2e name:ZooKeeperConnection Watcher:127.0.0.1:44111 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 17865 T21 oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 17865 T21 oascc.SolrZkClient.createZkACLProvider Using default ZkACLProvider
   [junit4]   2> 17869 T21 n:127.0.0.1:53715_ oascc.ConnectionManager.waitForConnected Waiting for client to connect to ZooKeeper
   [junit4]   2> 17877 T102 n:127.0.0.1:53715_ oascc.ConnectionManager.process Watcher org.apache.solr.common.cloud.ConnectionManager@38992357 name:ZooKeeperConnection Watcher:127.0.0.1:44111/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 17878 T21 n:127.0.0.1:53715_ oascc.ConnectionManager.waitForConnected Client is connected to ZooKeeper
   [junit4]   2> 17887 T21 n:127.0.0.1:53715_ oascc.ZkStateReader.createClusterStateWatchersAndUpdate Updating cluster state from ZooKeeper... 
   [junit4]   2> 18898 T21 n:127.0.0.1:53715_ oasc.ZkController.createEphemeralLiveNode Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53715_
   [junit4]   2> 18900 T21 n:127.0.0.1:53715_ oascc.SolrZkClient.makePath makePath: /live_nodes/127.0.0.1:53715_
   [junit4]   2> 18911 T21 n:127.0.0.1:53715_ oasc.Overseer.close Overseer (id=null) closing
   [junit4]   2> 18916 T21 n:127.0.0.1:53715_ oasc.CoreContainer.initializeAuthenticationPlugin No authentication plugin used.
   [junit4]   2> 18917 T21 n:127.0.0.1:53715_ oasc.CoreContainer.intializeAuthorizationPlugin Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 18918 T21 n:127.0.0.1:53715_ oasc.CorePropertiesLocator.discover Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/cores
   [junit4]   2> 18920 T21 n:127.0.0.1:53715_ oasc.CoreDescriptor.<init> CORE DESCRIPTOR: {loadOnStartup=true, config=solrconfig.xml, absoluteInstDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/cores/collection1/, schema=schema.xml, name=collection1, instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/cores/collection1, dataDir=data/, collection=collection1, transient=false, coreNodeName=, shard=}
   [junit4]   2> 18921 T21 n:127.0.0.1:53715_ oasc.CorePropertiesLocator.discoverUnder Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/cores/collection1/
   [junit4]   2> 18921 T21 n:127.0.0.1:53715_ oasc.CorePropertiesLocator.discover Found 1 core definitions
   [junit4]   2> 18923 T103 n:127.0.0.1:53715_ c:collection1 x:collection1 oasc.ZkController.publish publishing core=collection1 state=down collection=collection1
   [junit4]   2> 18923 T103 n:127.0.0.1:53715_ c:collection1 x:collection1 oasc.ZkController.publish numShards not found on descriptor - reading it from system property
   [junit4]   2> 18925 T50 n:127.0.0.1:36763_ oasc.DistributedQueue$LatchWatcher.process NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 18925 T103 n:127.0.0.1:53715_ oasc.ZkController.waitForCoreNodeName look for our core node name
   [junit4]   2> 18927 T51 n:127.0.0.1:36763_ oasc.Overseer$ClusterStateUpdater.run processMessage: queueSize: 1, message = {
   [junit4]   2> 	  "node_name":"127.0.0.1:53715_",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53715",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "roles":null} current state version: 8
   [junit4]   2> 18928 T51 n:127.0.0.1:36763_ oasco.ReplicaMutator.updateState Update state numShards=2 message={
   [junit4]   2> 	  "node_name":"127.0.0.1:53715_",
   [junit4]   2> 	  "operation":"state",
   [junit4]   2> 	  "base_url":"http://127.0.0.1:53715",
   [junit4]   2> 	  "numShards":"2",
   [junit4]   2> 	  "core":"collection1",
   [junit4]   2> 	  "collection":"collection1",
   [junit4]   2> 	  "shard":null,
   [junit4]   2> 	  "state":"down",
   [junit4]   2> 	  "roles":null}
   [junit4]   2> 18929 T51 n:127.0.0.1:36763_ oasco.ReplicaMutator.updateState Collection already exists with numShards=2
   [junit4]   2> 18929 T51 n:127.0.0.1:36763_ oasco.ReplicaMutator.updateState Assigning new node to shard shard=shard2
   [junit4]   2> 19039 T79 n:127.0.0.1:57985_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 19039 T102 n:127.0.0.1:53715_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 19039 T62 oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 19039 T50 n:127.0.0.1:36763_ oascc.ZkStateReader$2.process A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 3)
   [junit4]   2> 19927 T103 n:127.0.0.1:53715_ oasc.ZkController.waitForShardId waiting to find shard id in clusterstate for collection1
   [junit4]   2> 19927 T103 n:127.0.0.1:53715_ oasc.ZkController.createCollectionZkNode Check for collection zkNode:collection1
   [junit4]   2> 19929 T103 n:127.0.0.1:53715_ oasc.ZkController.createCollectionZkNode Collection zkNode exists
   [junit4]   2> 19929 T103 n:127.0.0.1:53715_ oascc.ZkStateReader.readConfigName Load collection config from:/collections/collection1
   [junit4]   2> 19931 T103 n:127.0.0.1:53715_ oascc.ZkStateReader.readConfigName path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 19931 T103 n:127.0.0.1:53715_ oasc.SolrResourceLoader.<init> new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest 104FB88EF14E2A84-001/shard-2-001/cores/collection1/'
   [junit4]   2> 19951 T103 n:127.0.0.1:53715_ oasc.Config.<init> loaded config solrconfig.xml with version 0 
   [junit4]   2> 19964 T103 n:127.0.0.1:53715_ oasc.SolrConfig.refreshRequestParams current version of requestparams : -1
   [junit4]   2> 19982 T103 n:127.0.0.1:53715_ oasc.SolrConfig.<init> Using Lucene MatchVersion: 5.2.0
   [junit4]   2> 20021 T103 n:127.0.0.1:53715_ oasc.SolrConfig.<init> Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 20023 T103 n:127.0.0.1:53715_ oass.IndexSchema.readSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 20039 T103 n:127.0.0.1:53715_ oass.IndexSchema.readSchema [collection1] Schema name=test
   [junit4]   2> 20369 T103 n:127.0.0.1:53715_ oass.OpenExchangeRatesOrgProvider.init Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 20383 T103 n:127.0.0.1:53715_ oass.IndexSchema.readSchema default search field in schema is text
   [junit4]   2> 20386 T103 n:127.0.0.1:53715_ oass.IndexSchema.readSchema unique key field: id
   [junit4]   2> 20421 T103 n:127.0.0.1:53715_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 20427 T103 n:127.0.0.1:53715_ oass.FileExchangeRateProvider.reload Reloading exchange rates from file currency.xml
   [junit4]   2> 20432 T103 n:127.0.0.1:53715_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 20434 T103 n:127.0.0.1:53715_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 20435 T103 n:127.0.0.1:53715_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Expected key, got STRING
   [junit4]   2> 20435 T103 n:127.0.0.1:53715_ oass.OpenExchangeRatesOrgProvider.reload Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 20437 T103 n:127.0.0.1:53715_ oass.OpenExchangeRatesOrgProvider$OpenExchangeRates.<init> WARN Unknown key IMPORTANT NOTE
   [junit4]   2> 20437 T103 n:127.0.0.1:53715_ oass.OpenExchangeRat

[...truncated too long message...]

a:2048)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:135)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:261)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 1043323 T4826 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher  java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@c3481a3 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@35c73d76[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 14]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:135)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:261)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 1043323 T4826 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher  java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@72a9f60e rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@35c73d76[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 14]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:135)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:261)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> 1043324 T4826 oaz.ClientCnxn$EventThread.processEvent ERROR Error while calling watcher  java.util.concurrent.RejectedExecutionException: Task org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1@1288f6e4 rejected from org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor@35c73d76[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 14]
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2048)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:821)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1372)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.execute(ExecutorUtil.java:135)
   [junit4]   2> 	at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:110)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.process(SolrZkClient.java:261)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:522)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:498)
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.method=test -Dtests.seed=104FB88EF14E2A84 -Dtests.multiplier=2 -Dtests.slow=true -Dtests.locale=es_ES -Dtests.timezone=Africa/Monrovia -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 33.7s J2 | BasicDistributedZkTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: commitWithin did not work on node: http://127.0.0.1:53712/dm/collection1 expected:<68> but was:<67>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([104FB88EF14E2A84:981B87545FB2477C]:0)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:344)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:960)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:935)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1043331 T4664 c:control_collection s:shard1 x:collection1 oas.SolrTestCaseJ4.deleteCore ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build/solr-core/test/J2/temp/solr.cloud.BasicDistributedZkTest 104FB88EF14E2A84-001
   [junit4]   2> 33677 T4663 ccr.ThreadLeakControl.checkThreadLeaks WARNING Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Lucene50, sim=DefaultSimilarity, locale=es_ES, timezone=Africa/Monrovia
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_72 (64-bit)/cpus=4,threads=1,free=208683848,total=480247808
   [junit4]   2> NOTE: All tests run in this JVM: [TestReloadAndDeleteDocs, HttpPartitionTest, TestArbitraryIndexDir, RuleEngineTest, HighlighterTest, RollingRestartTest, BadComponentTest, DistributedExpandComponentTest, CoreAdminHandlerTest, LeaderFailoverAfterPartitionTest, TestRestManager, TestRandomDVFaceting, TestSerializedLuceneMatchVersion, TestPivotHelperCode, TestCloudPivotFacet, TestManagedStopFilterFactory, ConvertedLegacyTest, TestFiltering, DistributedQueueTest, SolrCloudExampleTest, TestExactStatsCache, OutOfBoxZkACLAndCredentialsProvidersTest, BinaryUpdateRequestHandlerTest, TestMiniSolrCloudClusterSSL, PrimitiveFieldTypeTest, TestElisionMultitermQuery, TestObjectReleaseTracker, TestWordDelimiterFilterFactory, ShardRoutingCustomTest, SpatialRPTFieldTypeTest, DistributedTermsComponentTest, TestTolerantSearch, DirectSolrConnectionTest, TestAddFieldRealTimeGet, TestSuggestSpellingConverter, MBeansHandlerTest, TestSolrQueryParser, TestAnalyzeInfixSuggestions, TestLMJelinekMercerSimilarityFactory, SegmentsInfoRequestHandlerTest, DeleteInactiveReplicaTest, TestSolrDeletionPolicy1, TestInitParams, TestCopyFieldCollectionResource, ExternalCollectionsTest, TestQueryUtils, ScriptEngineTest, TriLevelCompositeIdRoutingTest, ResponseLogComponentTest, DistributedQueryComponentCustomSortTest, TestStressVersions, PingRequestHandlerTest, DocValuesTest, SolrIndexConfigTest, RulesTest, TestCloudManagedSchema, TestComplexPhraseQParserPlugin, TermVectorComponentTest, ActionThrottleTest, TestManagedResourceStorage, MergeStrategyTest, VMParamsZkACLAndCredentialsProvidersTest, SynonymTokenizerTest, TestRangeQuery, HdfsRecoverLeaseTest, TestFieldSortValues, TestRebalanceLeaders, NotRequiredUniqueKeyTest, TestExactSharedStatsCache, UUIDFieldTest, TestSystemIdResolver, CoreMergeIndexesAdminHandlerTest, TestUpdate, TestPostingsSolrHighlighter, OutputWriterTest, TestPhraseSuggestions, OverriddenZkACLAndCredentialsProvidersTest, TestDistributedSearch, BasicDistributedZkTest]
   [junit4] Completed [251/496] on J2 in 34.25s, 1 test, 1 failure <<< FAILURES!

[...truncated 781 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/build.xml:536: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/build.xml:484: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/build.xml:61: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/extra-targets.xml:39: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/build.xml:229: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/solr/common-build.xml:511: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/lucene/common-build.xml:1433: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-Tests-5.2-Java7/lucene/common-build.xml:991: There were test failures: 496 suites, 1973 tests, 1 suite-level error, 1 failure, 57 ignored (25 assumptions)

Total time: 51 minutes 33 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Sending artifact delta relative to Lucene-Solr-Tests-5.2-Java7 #4
Archived 4 artifacts
Archive block size is 32768
Received 0 blocks and 255127448 bytes
Compression is 0.0%
Took 41 sec
Recording test results
Email was triggered for: Failure
Sending email for trigger: Failure