You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2016/01/11 14:27:56 UTC

[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 1072 - Still Failing

Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/1072/

2 tests failed.
FAILED:  org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig

Error Message:
The max direct memory is likely too low.  Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.

Stack Trace:
java.lang.RuntimeException: The max direct memory is likely too low.  Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
	at __randomizedtesting.SeedInfo.seed([8F089C32D5F6338D:78A75519287FD9A6]:0)
	at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:296)
	at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:272)
	at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:213)
	at org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig(HdfsDirectoryFactoryTest.java:114)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.OutOfMemoryError: Direct buffer memory
	at java.nio.Bits.reserveMemory(Bits.java:658)
	at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
	at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:306)
	at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:64)
	at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:294)
	... 42 more


FAILED:  org.apache.solr.index.hdfs.CheckHdfsIndexTest.doTest

Error Message:
Could not find a healthy node to handle the request.

Stack Trace:
org.apache.solr.common.SolrException: Could not find a healthy node to handle the request.
	at __randomizedtesting.SeedInfo.seed([8F089C32D5F6338D:284C2496B84D2034]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1085)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:954)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:954)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:954)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:954)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:954)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
	at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:483)
	at org.apache.solr.client.solrj.SolrClient.commit(SolrClient.java:464)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.commit(AbstractFullDistribZkTestBase.java:1505)
	at org.apache.solr.index.hdfs.CheckHdfsIndexTest.doTest(CheckHdfsIndexTest.java:101)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10830 lines...]
   [junit4] JVM J1: stdout was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20160111_120123_535.sysout
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] Dumping heap to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/heapdumps/java_pid21414.hprof ...
   [junit4] Heap dump file created [609670035 bytes in 5.932 secs]
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20160111_120123_535.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] WARN: Unhandled exception in event serialization. -> java.lang.OutOfMemoryError: GC overhead limit exceeded
   [junit4] <<< JVM J1: EOF ----

[...truncated 602 lines...]
   [junit4] Suite: org.apache.solr.core.HdfsDirectoryFactoryTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/init-core-data-001
   [junit4]   2> 4173609 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true)
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 4173644 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 4173650 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4173652 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4173666 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_53663_hdfs____.sab96p/webapp
   [junit4]   2> 4173781 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4173943 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:53663
   [junit4]   2> 4173998 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4173999 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4174016 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_36910_datanode____e2cc3g/webapp
   [junit4]   2> 4174133 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4174341 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36910
   [junit4]   2> 4174371 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4174373 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4174386 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_41924_datanode____.k4zgcb/webapp
   [junit4]   2> 4174411 INFO  (IPC Server handler 3 on 58558) [    ] BlockStateChange BLOCK* processReport: from storage DS-6acc99d6-5839-4162-bd2d-c8063b375e41 node DatanodeRegistration(127.0.0.1, datanodeUuid=10416d2b-5638-40bc-a743-3ecf129c4740, infoPort=36910, ipcPort=39544, storageInfo=lv=-56;cid=testClusterID;nsid=1325544583;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 4174411 INFO  (IPC Server handler 3 on 58558) [    ] BlockStateChange BLOCK* processReport: from storage DS-9bcd3ee7-a123-4e9a-bf10-ffe94cbbdf2d node DatanodeRegistration(127.0.0.1, datanodeUuid=10416d2b-5638-40bc-a743-3ecf129c4740, infoPort=36910, ipcPort=39544, storageInfo=lv=-56;cid=testClusterID;nsid=1325544583;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4174509 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4174715 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41924
   [junit4]   2> 4174787 INFO  (IPC Server handler 8 on 58558) [    ] BlockStateChange BLOCK* processReport: from storage DS-9ab7abe7-74aa-41c0-a006-f29ef21d5d03 node DatanodeRegistration(127.0.0.1, datanodeUuid=12802cc4-6db1-4ef5-8642-74a794f9f7e4, infoPort=41924, ipcPort=46508, storageInfo=lv=-56;cid=testClusterID;nsid=1325544583;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 4174787 INFO  (IPC Server handler 8 on 58558) [    ] BlockStateChange BLOCK* processReport: from storage DS-0ae8619b-5584-4676-91c1-ab5b358cf654 node DatanodeRegistration(127.0.0.1, datanodeUuid=12802cc4-6db1-4ef5-8642-74a794f9f7e4, infoPort=41924, ipcPort=46508, storageInfo=lv=-56;cid=testClusterID;nsid=1325544583;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4174881 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCleanupOldIndexDirectories
   [junit4]   2> 4174881 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58558/solr1
   [junit4]   2> 4174881 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4174881 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer New CoreContainer 705101462
   [junit4]   2> 4174881 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {configSetProperties=configsetprops.json, transient=false, schema=schema.xml, name=mock, config=solrconfig.xml, loadOnStartup=true, dataDir=data/}
   [junit4]   2> 4174900 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Deleted old index directory hdfs://localhost:58558/solr1/mock/data/index.20160111141101588
   [junit4]   2> 4174901 INFO  (TEST-HdfsDirectoryFactoryTest.testCleanupOldIndexDirectories-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCleanupOldIndexDirectories
   [junit4]   2> 4174938 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLocalityReporter
   [junit4]   2> 4174947 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58558/solr
   [junit4]   2> 4174948 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4174948 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58558/solr3/
   [junit4]   2> 4174960 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.s.h.HdfsLocalityReporter Registering direcotry hdfs://localhost:58558/solr3 for locality metrics.
   [junit4]   2> 4174971 INFO  (IPC Server handler 1 on 58558) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:38183 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bcd3ee7-a123-4e9a-bf10-ffe94cbbdf2d:NORMAL:127.0.0.1:52681|RBW], ReplicaUnderConstruction[[DISK]DS-9ab7abe7-74aa-41c0-a006-f29ef21d5d03:NORMAL:127.0.0.1:38183|RBW]]} size 0
   [junit4]   2> 4174971 INFO  (IPC Server handler 2 on 58558) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:52681 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-9bcd3ee7-a123-4e9a-bf10-ffe94cbbdf2d:NORMAL:127.0.0.1:52681|RBW], ReplicaUnderConstruction[[DISK]DS-9ab7abe7-74aa-41c0-a006-f29ef21d5d03:NORMAL:127.0.0.1:38183|RBW]]} size 0
   [junit4]   2> 4174976 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CachingDirectoryFactory Closing HdfsDirectoryFactory - 0 directories currently being tracked
   [junit4]   2> 4174976 INFO  (TEST-HdfsDirectoryFactoryTest.testLocalityReporter-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testLocalityReporter
   [junit4]   2> 4175014 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testInitArgsOrSysPropConfig
   [junit4]   2> 4175014 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58558/solr1
   [junit4]   2> 4175014 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer New CoreContainer 1804671906
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {configSetProperties=configsetprops.json, transient=false, schema=schema.xml, name=mock, loadOnStartup=true, config=solrconfig.xml, dataDir=data/}
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58558/solr2
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer New CoreContainer 61693914
   [junit4]   2> 4175015 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {config=solrconfig.xml, configSetProperties=configsetprops.json, schema=schema.xml, transient=false, dataDir=data/, loadOnStartup=true, name=mock}
   [junit4]   2> 4175016 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:58558/solr2
   [junit4]   2> 4175016 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4175016 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer New CoreContainer 1802494744
   [junit4]   2> 4175016 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {loadOnStartup=true, configSetProperties=configsetprops.json, config=solrconfig.xml, schema=schema.xml, name=mock, transient=false, dataDir=data/}
   [junit4]   2> 4175016 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:58558/solr
   [junit4]   2> 4175028 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 4175028 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [134217728] will allocate [1] slabs and use ~[134217728] bytes
   [junit4]   2> 4175028 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.HdfsDirectoryFactory Creating new single instance HDFS BlockCache
   [junit4]   2> 4175613 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1802494744
   [junit4]   2> 4175614 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=61693914
   [junit4]   2> 4175614 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=1804671906
   [junit4]   2> 4175614 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=705101462
   [junit4]   2> 4175708 INFO  (TEST-HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testInitArgsOrSysPropConfig
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HdfsDirectoryFactoryTest -Dtests.method=testInitArgsOrSysPropConfig -Dtests.seed=8F089C32D5F6338D -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=lt -Dtests.timezone=Europe/Belgrade -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.73s J2 | HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig <<<
   [junit4]    > Throwable #1: java.lang.RuntimeException: The max direct memory is likely too low.  Either increase it (by adding -XX:MaxDirectMemorySize=<size>g -XX:+UseLargePages to your containers startup args) or disable direct allocation using solr.hdfs.blockcache.direct.memory.allocation=false in solrconfig.xml. If you are putting the block cache on the heap, your java heap size might not be large enough. Failed allocating ~134.217728 MB.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([8F089C32D5F6338D:78A75519287FD9A6]:0)
   [junit4]    > 	at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:296)
   [junit4]    > 	at org.apache.solr.core.HdfsDirectoryFactory.getBlockDirectoryCache(HdfsDirectoryFactory.java:272)
   [junit4]    > 	at org.apache.solr.core.HdfsDirectoryFactory.create(HdfsDirectoryFactory.java:213)
   [junit4]    > 	at org.apache.solr.core.HdfsDirectoryFactoryTest.testInitArgsOrSysPropConfig(HdfsDirectoryFactoryTest.java:114)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: java.lang.OutOfMemoryError: Direct buffer memory
   [junit4]    > 	at java.nio.Bits.reserveMemory(Bits.java:658)
   [junit4]    > 	at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123)
   [junit4]    > 	at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:306)
   [junit4]    > 	at org.apache.solr.store.blockcache.BlockCache.<init>(BlockCache.java:64)
   [junit4]    > 	at org.apache.solr.core.HdfsDirectoryFactory.createBlockCache(HdfsDirectoryFactory.java:294)
   [junit4]    > 	... 42 more
   [junit4]   2> 4175712 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 4175718 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 4175721 WARN  (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost/127.0.0.1:58558) [    ] o.a.h.h.s.d.DataNode BPOfferService for Block pool BP-1343184817-10.41.0.5-1452517860327 (Datanode Uuid 12802cc4-6db1-4ef5-8642-74a794f9f7e4) service to localhost/127.0.0.1:58558 interrupted
   [junit4]   2> 4175721 WARN  (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data3/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data4/]]  heartbeating to localhost/127.0.0.1:58558) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-1343184817-10.41.0.5-1452517860327 (Datanode Uuid 12802cc4-6db1-4ef5-8642-74a794f9f7e4) service to localhost/127.0.0.1:58558
   [junit4]   2> 4175724 WARN  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.s.d.DirectoryScanner DirectoryScanner: shutdown has been called
   [junit4]   2> 4175728 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 4175830 WARN  (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost/127.0.0.1:58558) [    ] o.a.h.h.s.d.DataNode BPOfferService for Block pool BP-1343184817-10.41.0.5-1452517860327 (Datanode Uuid 10416d2b-5638-40bc-a743-3ecf129c4740) service to localhost/127.0.0.1:58558 interrupted
   [junit4]   2> 4175830 WARN  (DataNode: [[[DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data1/, [DISK]file:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001/tempDir-001/hdfsBaseDir/data/data2/]]  heartbeating to localhost/127.0.0.1:58558) [    ] o.a.h.h.s.d.DataNode Ending block pool service for: Block pool BP-1343184817-10.41.0.5-1452517860327 (Datanode Uuid 10416d2b-5638-40bc-a743-3ecf129c4740) service to localhost/127.0.0.1:58558
   [junit4]   2> 4175838 WARN  (org.apache.hadoop.hdfs.server.blockmanagement.DecommissionManager$Monitor@9d3a9f1) [    ] o.a.h.h.s.b.DecommissionManager Monitor interrupted: java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 4175850 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 4175952 ERROR (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
   [junit4]   2> java.lang.reflect.InvocationTargetException
   [junit4]   2> 	at sun.reflect.GeneratedMethodAccessor136.invoke(Unknown Source)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:606)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.cloud.hdfs.HdfsTestUtil.teardownClass(HdfsTestUtil.java:199)
   [junit4]   2> 	at org.apache.solr.core.HdfsDirectoryFactoryTest.teardownClass(HdfsDirectoryFactoryTest.java:67)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:606)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 4175956 INFO  (SUITE-HdfsDirectoryFactoryTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J2/temp/solr.core.HdfsDirectoryFactoryTest_8F089C32D5F6338D-001
   [junit4]   2> Jan 11, 2016 1:11:02 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene54): {}, docValues:{}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=lt, timezone=Europe/Belgrade
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_80 (64-bit)/cpus=4,threads=2,free=395209656,total=520617984
   [junit4]   2> NOTE: All tests run in this JVM: [TestConfigSetImmutable, TestExtendedDismaxParser, TestPerFieldSimilarity, TestCharFilters, TestLeaderInitiatedRecoveryThread, TestRestoreCore, AsyncCallRequestStatusResponseTest, TestSolrQueryParser, StressHdfsTest, TestSolrIndexConfig, TestSearcherReuse, SolrTestCaseJ4Test, UnloadDistributedZkTest, PKIAuthenticationIntegrationTest, TestFieldSortValues, OverriddenZkACLAndCredentialsProvidersTest, RollingRestartTest, SpatialRPTFieldTypeTest, TestSuggestSpellingConverter, TestConfigReload, TestSolr4Spatial2, HLLSerializationTest, TestManagedSchemaFieldResource, TestSortingResponseWriter, AutoCommitTest, TestConfigSetsAPIZkFailure, TestRebalanceLeaders, TestMaxScoreQueryParser, TestSchemaVersionResource, TestMacros, QueryParsingTest, ClusterStateTest, AnalysisErrorHandlingTest, TestManagedSchema, TestGroupingSearch, RequestHandlersTest, TestSchemaNameResource, TestUseDocValuesAsStored2, CachingDirectoryFactoryTest, CoreAdminCreateDiscoverTest, DebugComponentTest, TestSolrJ, TestJmxIntegration, ShardSplitTest, TestShardHandlerFactory, DistanceUnitsTest, TestPostingsSolrHighlighter, StatelessScriptUpdateProcessorFactoryTest, LeaderElectionTest, TestReRankQParserPlugin, BinaryUpdateRequestHandlerTest, SortSpecParsingTest, CleanupOldIndexTest, SampleTest, DeleteReplicaTest, DistributedSuggestComponentTest, TestCollationField, TestCopyFieldCollectionResource, FieldMutatingUpdateProcessorTest, TestManagedSynonymFilterFactory, NoCacheHeaderTest, TestReversedWildcardFilterFactory, TestRuleBasedAuthorizationPlugin, SuggestComponentContextFilterQueryTest, TestSort, OverseerTest, CollectionStateFormat2Test, TestSolrXml, TestIndexSearcher, UpdateParamsTest, TestRecovery, TestSolrDeletionPolicy1, TestRequestStatusCollectionAPI, TestDefaultStatsCache, ScriptEngineTest, TestCollectionAPI, SuggesterWFSTTest, TestJmxMonitoredMap, TestReload, TestDownShardTolerantSearch, TestOverriddenPrefixQueryForCustomFieldType, SuggesterTSTTest, ZkStateWriterTest, TestFastWriter, TestXIncludeConfig, TestScoreJoinQPNoScore, TestSearchPerf, TestRestManager, TestFieldTypeCollectionResource, TestAuthenticationFramework, TriLevelCompositeIdRoutingTest, BasicDistributedZk2Test, HardAutoCommitTest, TestRangeQuery, SimpleFacetsTest, SolrCmdDistributorTest, QueryElevationComponentTest, PeerSyncTest, BadIndexSchemaTest, TestFiltering, BasicFunctionalityTest, ShowFileRequestHandlerTest, TestCoreDiscovery, CoreAdminHandlerTest, SpatialFilterTest, SchemaVersionSpecificBehaviorTest, TestPseudoReturnFields, TestUpdate, QueryEqualityTest, SortByFunctionTest, SolrInfoMBeanTest, LukeRequestHandlerTest, DirectSolrSpellCheckerTest, TestQueryTypes, TestOmitPositions, TestIndexingPerformance, FieldAnalysisRequestHandlerTest, LoggingHandlerTest, IndexSchemaTest, TestCSVResponseWriter, TestAnalyzedSuggestions, JsonLoaderTest, TestPHPSerializedResponseWriter, CSVRequestHandlerTest, SearchHandlerTest, TestLFUCache, PrimUtilsTest, SpellingQueryConverterTest, RAMDirectoryFactoryTest, TestUtils, ZkNodePropsTest, SliceStateTest, UUIDFieldTest, CircularListTest, DistributedMLTComponentTest, TestRTGBase, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestSimpleTrackingShardHandler, TestTolerantSearch, TestEmbeddedSolrServerConstructors, ActionThrottleTest, AliasIntegrationTest, AssignTest, ConcurrentDeleteAndCreateCollectionTest, DeleteLastCustomShardedReplicaTest, DeleteShardTest, DistribDocExpirationUpdateProcessorTest, LeaderFailoverAfterPartitionTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerRolesTest, OverseerTaskQueueTest, RemoteQueryErrorTest, SSLMigrationTest, SaslZkACLProviderTest, SharedFSAutoReplicaFailoverUtilsTest, SimpleCollectionCreateDeleteTest, TestDistribDocBasedVersion, TestExclusionRuleCollectionAccess, TestMiniSolrCloudCluster, TestSolrCloudWithKerberosAlt, HdfsBasicDistributedZk2Test, HdfsChaosMonkeyNothingIsSafeTest, HdfsCollectionsAPIDistributedZkTest, HdfsNNFailoverTest, HdfsRecoverLeaseTest, HdfsRecoveryZkTest, HdfsThreadLeakTest, HdfsUnloadDistributedZkTest, HdfsWriteToMultipleCollectionsTest, DirectoryFactoryTest, HdfsDirectoryFactoryTest]
   [junit4] Completed [392/563 (1!)] on J2 in 12.24s, 3 tests, 1 error <<< FAILURES!

[...truncated 141 lines...]
   [junit4] Suite: org.apache.solr.index.hdfs.CheckHdfsIndexTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/init-core-data-001
   [junit4]   2> 4342768 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 4342768 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   1> Formatting using clusterid: testClusterID
   [junit4]   2> 4342823 WARN  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.m.i.MetricsConfig Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties
   [junit4]   2> 4342833 WARN  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4342836 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4342851 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/hdfs to ./temp/Jetty_localhost_46627_hdfs____igpckj/webapp
   [junit4]   2> 4342969 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4343225 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46627
   [junit4]   2> 4343287 WARN  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4343288 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4343301 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_37565_datanode____.i40y15/webapp
   [junit4]   2> 4343420 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4343747 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37565
   [junit4]   2> 4343788 WARN  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.a.h.h.HttpRequestLog Jetty request log can only be enabled using Log4j
   [junit4]   2> 4343790 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log jetty-6.1.26
   [junit4]   2> 4343808 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Extract jar:file:/x1/jenkins/.ivy2/cache/org.apache.hadoop/hadoop-hdfs/tests/hadoop-hdfs-2.6.0-tests.jar!/webapps/datanode to ./temp/Jetty_localhost_57628_datanode____.k7473/webapp
   [junit4]   2> 4343861 INFO  (IPC Server handler 3 on 45277) [    ] BlockStateChange BLOCK* processReport: from storage DS-5425b123-006c-4d62-b8b5-e8ad6be4168d node DatanodeRegistration(127.0.0.1, datanodeUuid=53147476-ab76-433d-b821-7ffed9dbe7d8, infoPort=37565, ipcPort=42432, storageInfo=lv=-56;cid=testClusterID;nsid=1800155769;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 4343861 INFO  (IPC Server handler 3 on 45277) [    ] BlockStateChange BLOCK* processReport: from storage DS-4909e491-591a-42fa-b72c-1c8e79000a33 node DatanodeRegistration(127.0.0.1, datanodeUuid=53147476-ab76-433d-b821-7ffed9dbe7d8, infoPort=37565, ipcPort=42432, storageInfo=lv=-56;cid=testClusterID;nsid=1800155769;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4343953 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log NO JSP Support for /, did not find org.apache.jasper.servlet.JspServlet
   [junit4]   2> 4344172 INFO  (SUITE-CheckHdfsIndexTest-seed#[8F089C32D5F6338D]-worker) [    ] o.m.log Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:57628
   [junit4]   2> 4344254 INFO  (IPC Server handler 8 on 45277) [    ] BlockStateChange BLOCK* processReport: from storage DS-eac235cc-8b4b-4730-b5aa-ab6a40b2f47d node DatanodeRegistration(127.0.0.1, datanodeUuid=8985b884-e001-4a1e-8937-e60e78f5219f, infoPort=57628, ipcPort=55836, storageInfo=lv=-56;cid=testClusterID;nsid=1800155769;c=0), blocks: 0, hasStaleStorages: true, processing time: 0 msecs
   [junit4]   2> 4344254 INFO  (IPC Server handler 8 on 45277) [    ] BlockStateChange BLOCK* processReport: from storage DS-79cde9ca-ce66-420b-8081-f9c1d37b0741 node DatanodeRegistration(127.0.0.1, datanodeUuid=8985b884-e001-4a1e-8937-e60e78f5219f, infoPort=57628, ipcPort=55836, storageInfo=lv=-56;cid=testClusterID;nsid=1800155769;c=0), blocks: 0, hasStaleStorages: false, processing time: 0 msecs
   [junit4]   2> 4344386 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 4344386 INFO  (Thread-237313) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 4344386 INFO  (Thread-237313) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 4344486 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.ZkTestServer start zk server on port:40186
   [junit4]   2> 4344487 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4344487 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4344490 INFO  (zkCallback-2515-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@bfbb183 name:ZooKeeperConnection Watcher:127.0.0.1:40186 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4344490 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4344491 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4344491 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 4344494 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4344494 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4344496 INFO  (zkCallback-2516-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5b315586 name:ZooKeeperConnection Watcher:127.0.0.1:40186/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4344496 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4344496 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4344496 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 4344498 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 4344500 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 4344501 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 4344503 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 4344503 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 4344506 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 4344506 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 4344508 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4344508 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 4344509 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 4344510 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 4344511 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 4344511 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 4344513 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 4344513 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 4344515 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 4344515 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 4344516 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4344517 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 4344518 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4344518 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 4344520 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 4344520 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 4344522 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 4344522 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 4344819 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores/collection1
   [junit4]   2> 4344821 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 4344823 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4603914c{/,null,AVAILABLE}
   [junit4]   2> 4344823 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.e.j.s.ServerConnector Started ServerConnector@7704a0e9{HTTP/1.1}{127.0.0.1:54596}
   [junit4]   2> 4344823 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.e.j.s.Server Started @4347668ms
   [junit4]   2> 4344823 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=54596, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores, solr.data.dir=hdfs://localhost:45277/hdfs__localhost_45277__x1_jenkins_jenkins-slave_workspace_Lucene-Solr-NightlyTests-5.x_solr_build_solr-core_test_J0_temp_solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001_tempDir-002_control_data}
   [junit4]   2> 4344823 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@7b3cb2c6
   [junit4]   2> 4344824 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001'
   [junit4]   2> 4344824 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4344824 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 4344824 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4344825 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4344826 INFO  (zkCallback-2517-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1226be15 name:ZooKeeperConnection Watcher:127.0.0.1:40186/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4344826 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4344827 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4344828 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 4344828 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/solr.xml
   [junit4]   2> 4344842 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores
   [junit4]   2> 4344843 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer New CoreContainer 553885970
   [junit4]   2> 4344843 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001]
   [junit4]   2> 4344843 WARN  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/lib
   [junit4]   2> 4344843 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 4344844 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 4344845 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 4344845 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 4344845 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:40186/solr
   [junit4]   2> 4344845 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 4344845 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 4344846 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4344847 INFO  (zkCallback-2519-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@32835e5f name:ZooKeeperConnection Watcher:127.0.0.1:40186 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4344847 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4344847 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 4344849 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 4344850 INFO  (zkCallback-2520-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@24f6cedf name:ZooKeeperConnection Watcher:127.0.0.1:40186/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 4344850 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 4344851 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 4344853 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 4344855 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 4344857 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 4344858 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 4344860 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 4344861 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 4344863 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 4344864 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 4344864 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:54596_
   [junit4]   2> 4344865 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:54596_
   [junit4]   2> 4344866 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 4344867 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 4344868 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4344869 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95192221676732420-127.0.0.1:54596_-n_0000000000
   [junit4]   2> 4344869 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:54596_
   [junit4]   2> 4344869 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 4344871 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.Overseer Overseer (id=95192221676732420-127.0.0.1:54596_-n_0000000000) starting
   [junit4]   2> 4344872 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 4344877 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 4344878 INFO  (OverseerCollectionConfigSetProcessor-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 4344878 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 4344878 INFO  (OverseerStateUpdate-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 4344896 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 4344896 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 4344897 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores
   [junit4]   2> 4344898 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {collection=control_collection, coreNodeName=, loadOnStartup=true, config=solrconfig.xml, shard=, schema=schema.xml, configSetProperties=configsetprops.json, dataDir=data/, name=collection1, transient=false}
   [junit4]   2> 4344898 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores/collection1
   [junit4]   2> 4344898 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 4344899 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
   [junit4]   2> 4344900 INFO  (TEST-CheckHdfsIndexTest.testChecksumsOnly-seed#[8F089C32D5F6338D]) [n:127.0.0.1:54596_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 4344900 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 4344900 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 4344902 INFO  (OverseerStateUpdate-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "node_name":"127.0.0.1:54596_",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:54596",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down"} current state version: 0
   [junit4]   2> 4344903 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 4344903 INFO  (OverseerStateUpdate-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "node_name":"127.0.0.1:54596_",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:54596",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down"}
   [junit4]   2> 4344903 INFO  (OverseerStateUpdate-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 4344904 INFO  (OverseerStateUpdate-95192221676732420-127.0.0.1:54596_-n_0000000000) [n:127.0.0.1:54596_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 4344905 INFO  (zkCallback-2520-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 4345903 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 4345903 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 4345904 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 4345904 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 4345905 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 4345905 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores/collection1'
   [junit4]   2> 4345906 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 4345906 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 4345909 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 4345914 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 4345928 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 4345956 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 4345964 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 4346226 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 4346234 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 4346236 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 4346245 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4346248 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 4346251 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4346252 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 4346253 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
   [junit4]   2> 4346253 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 4346254 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.HdfsDirectoryFactory
   [junit4]   2> 4346254 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory solr.hdfs.home=hdfs://localhost:45277/solr_hdfs_home
   [junit4]   2> 4346254 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Solr Kerberos Authentication disabled
   [junit4]   2> 4346254 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.index.hdfs.CheckHdfsIndexTest_8F089C32D5F6338D-001/control-001/cores/collection1], dataDir=[hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/]
   [junit4]   2> 4346254 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@5a872a2d
   [junit4]   2> 4346255 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4346271 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data
   [junit4]   2> 4346272 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/index/
   [junit4]   2> 4346282 WARN  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory 'hdfs:/localhost:45277/solr_hdfs_home/control_collection/core_node1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 4346282 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory creating directory factory for path hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4346291 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Number of slabs of block cache [1] with direct memory allocation set to [true]
   [junit4]   2> 4346291 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.HdfsDirectoryFactory Block cache target memory usage, slab size of [8388608] will allocate [1] slabs and use ~[8388608] bytes
   [junit4]   2> 4346295 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.b.BlockDirectory Block cache on write is disabled
   [junit4]   2> 4346295 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/index
   [junit4]   2> 4346295 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=5, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 4346310 INFO  (IPC Server handler 4 on 45277) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:55884 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-4909e491-591a-42fa-b72c-1c8e79000a33:NORMAL:127.0.0.1:51362|RBW], ReplicaUnderConstruction[[DISK]DS-79cde9ca-ce66-420b-8081-f9c1d37b0741:NORMAL:127.0.0.1:55884|FINALIZED]]} size 0
   [junit4]   2> 4346311 INFO  (IPC Server handler 5 on 45277) [    ] BlockStateChange BLOCK* addStoredBlock: blockMap updated: 127.0.0.1:51362 is added to blk_1073741825_1001{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, replicas=[ReplicaUnderConstruction[[DISK]DS-79cde9ca-ce66-420b-8081-f9c1d37b0741:NORMAL:127.0.0.1:55884|FINALIZED], ReplicaUnderConstruction[[DISK]DS-5425b123-006c-4d62-b8b5-e8ad6be4168d:NORMAL:127.0.0.1:51362|FINALIZED]]} size 0
   [junit4]   2> 4346314 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=NRTCachingDirectory(BlockDirectory(HdfsDirectory@hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/index lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@672f5e74); maxCacheMB=192.0 maxMergeSizeMB=16.0),segFN=segments_1,generation=1}
   [junit4]   2> 4346314 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 4346325 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in hdfs://localhost:45277/solr_hdfs_home/control_collection/core_node1/data/
   [junit4]   2> 4346328 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 4346328 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 4346328 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 4346329 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 4346329 WARN  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 4346332 INFO  (coreLoadExecutor-8237-thread-1-processing-n:127.0.0.1:54596_) [n:127.0.0.1:54596_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xs

[...truncated too long message...]

/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-admin-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-authn-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-authz-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-changelog-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-collective-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-event-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-exception-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-journal-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-normalization-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-operational-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-referral-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-schema-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-subtree-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-interceptors-trigger-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-jdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-jdbm1-2.0.0-M2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-kerberos-codec-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-ldif-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-mavibot-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-protocol-kerberos-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-protocol-ldap-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-protocol-shared-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/apacheds-xdbm-partition-2.0.0-M15.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/api-all-1.0.0-M20.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/bcprov-jdk15-1.45.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/cglib-nodep-2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/commons-collections-3.2.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/commons-math3-3.4.1.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/easymock-3.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/ehcache-core-2.4.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/hadoop-common-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/hadoop-hdfs-2.6.0-tests.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/hadoop-minikdc-2.6.0.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jackson-annotations-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jackson-databind-2.5.4.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jersey-core-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jersey-server-1.9.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jetty-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/jetty-util-6.1.26.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/mina-core-2.0.0-M5.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/test-lib/objenesis-1.2.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/build/analysis/icu/lucene-analyzers-icu-5.5.0-SNAPSHOT.jar:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-analysis-extras/classes/java:/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/contrib/analysis-extras/lib/icu4j-54.1.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-launcher.jar:/x1/jenkins/.ant/lib/ivy-2.3.0.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-antlr.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-regexp.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-resolver.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-net.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jmf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-oro.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-xalan2.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-commons-logging.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jsch.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit4.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-javamail.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jai.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-jdepend.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-junit.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bsf.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-swing.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-netrexx.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-bcel.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-testutil.jar:/home/jenkins/jenkins-slave/tools/hudson.tasks.Ant_AntInstallation/ant-1.8.2/lib/ant-apache-log4j.jar:/x1/jenkins/jenkins-slave/tools/hudson.model.JDK/latest1.7/lib/tools.jar:/x1/jenkins/.ivy2/cache/com.carrotsearch.randomizedtesting/junit4-ant/jars/junit4-ant-2.3.2.jar com.carrotsearch.ant.tasks.junit4.slave.SlaveMainSafe -eventsfile /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20160111_120123_535.events @/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/temp/junit4-J1-20160111_120123_535.suites -stdin
   [junit4] ERROR: JVM J1 ended with an exception: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.executeSlave(JUnit4.java:1501)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4.access$000(JUnit4.java:121)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:955)
   [junit4] 	at com.carrotsearch.ant.tasks.junit4.JUnit4$2.call(JUnit4.java:952)
   [junit4] 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4] 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4] 	at java.lang.Thread.run(Thread.java:745)

BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:801: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:738: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:526: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1444: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1000: At least one slave process threw an exception, first: Quit event not received from the forked process? This may indicate JVM crash or runner bugs.

Total time: 230 minutes 54 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 1077 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/1077/

5 tests failed.
FAILED:  org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun

Error Message:
Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":42405; 

Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":42405; 
	at __randomizedtesting.SeedInfo.seed([6AA3CDACAB3E11E8:64F179A2AAA823E7]:0)
	at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
	at org.apache.hadoop.ipc.Client.call(Client.java:1472)
	at org.apache.hadoop.ipc.Client.call(Client.java:1399)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
	at com.sun.proxy.$Proxy47.getClusterMetrics(Unknown Source)
	at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
	at com.sun.proxy.$Proxy48.getClusterMetrics(Unknown Source)
	at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
	at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
	at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
	at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
	at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
	at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
	at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
	at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:645)
	at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:608)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.solr.hadoop.MorphlineBasicMiniMRTest.mrRun(MorphlineBasicMiniMRTest.java:363)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Connection reset by peer
	at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
	at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
	at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
	at sun.nio.ch.IOUtil.read(IOUtil.java:197)
	at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:384)
	at org.apache.hadoop.net.SocketInputStream$Reader.performIO(SocketInputStream.java:57)
	at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
	at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
	at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
	at java.io.FilterInputStream.read(FilterInputStream.java:133)
	at java.io.FilterInputStream.read(FilterInputStream.java:133)
	at org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:513)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:254)
	at java.io.DataInputStream.readInt(DataInputStream.java:387)
	at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1071)
	at org.apache.hadoop.ipc.Client$Connection.run(Client.java:966)


FAILED:  org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test

Error Message:
Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":42345; 

Stack Trace:
java.io.IOException: Failed on local exception: java.io.IOException: Connection reset by peer; Host Details : local host is: "lucene1-us-west/10.41.0.5"; destination host is: "lucene1-us-west.apache.org":42345; 
	at __randomizedtesting.SeedInfo.seed([6AA3CDACAB3E11E8:E2F7F27605C27C10]:0)
	at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:772)
	at org.apache.hadoop.ipc.Client.call(Client.java:1472)
	at org.apache.hadoop.ipc.Client.call(Client.java:1399)
	at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232)
	at com.sun.proxy.$Proxy47.getClusterMetrics(Unknown Source)
	at org.apache.hadoop.yarn.api.impl.pb.client.ApplicationClientProtocolPBClientImpl.getClusterMetrics(ApplicationClientProtocolPBClientImpl.java:202)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:187)
	at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:102)
	at com.sun.proxy.$Proxy48.getClusterMetrics(Unknown Source)
	at org.apache.hadoop.yarn.client.api.impl.YarnClientImpl.getYarnClusterMetrics(YarnClientImpl.java:461)
	at org.apache.hadoop.mapred.ResourceMgrDelegate.getClusterMetrics(ResourceMgrDelegate.java:151)
	at org.apache.hadoop.mapred.YARNRunner.getClusterMetrics(YARNRunner.java:179)
	at org.apache.hadoop.mapreduce.Cluster.getClusterStatus(Cluster.java:246)
	at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:719)
	at org.apache.hadoop.mapred.JobClient$3.run(JobClient.java:717)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:415)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
	at org.apache.hadoop.mapred.JobClient.getClusterStatus(JobClient.java:717)
	at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:645)
	at org.apache.solr.hadoop.MapReduceIndexerTool.run(MapReduceIndexerTool.java:608)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.test(MorphlineGoLiveMiniMRTest.java:402)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Connection reset by peer
	at sun.nio.ch.FileDispatcherImpl.read0(Native Method)
	at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39)
	at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
	at sun.nio.ch.IOUtil.read(IOUtil.java:197)
	at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:384)
	at org.apache.hadoop.net.SocketInputStream$Reader.performIO(SocketInputStream.java:57)
	at org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:142)
	at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
	at org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
	at java.io.FilterInputStream.read(FilterInputStream.java:133)
	at java.io.FilterInputStream.read(FilterInputStream.java:133)
	at org.apache.hadoop.ipc.Client$Connection$PingInputStream.read(Client.java:513)
	at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
	at java.io.BufferedInputStream.read(BufferedInputStream.java:254)
	at java.io.DataInputStream.readInt(DataInputStream.java:387)
	at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:1071)
	at org.apache.hadoop.ipc.Client$Connection.run(Client.java:966)


FAILED:  org.apache.solr.hadoop.MorphlineMapperTest.testMapper

Error Message:
Malformed / non-existent locale:  near: {     # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 198     "fmap" : {         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 198         "content-type" : "content_type",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 198         "content" : "text"     },     # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 160     #  captureAttr : true # default is false     "capture" : [         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 163         #  twitter feed schema         "user_friends_count",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 164         "user_location",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 165         "user_description",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 166         "user_statuses_count",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 167         "user_followers_count",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 168         "user_name",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 169         "user_screen_name",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 170         "created_at",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 171         "text",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 172         "retweet_count",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 173         "retweeted",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 174         "in_reply_to_user_id",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 175         "source",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 176         "in_reply_to_status_id",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 177         "media_url_https",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 178         "expanded_url",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 181         #  file metadata            "file_download_url",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 182         "file_upload_url",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 183         "file_scheme",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 184         "file_host",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 185         "file_port",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 186         "file_path",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 187         "file_name",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 188         "file_length",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 189         "file_last_modified",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 190         "file_owner",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 191         "file_group",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 192         "file_permissions_user",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 193         "file_permissions_group",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 194         "file_permissions_other",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 195         "file_permissions_stickybit"     ],     # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 199     #  rename "content" field to "text" fields     "dateFormats" : [         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 199         "yyyy-MM-dd'T'HH:mm:ss",         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 199         "yyyy-MM-dd"     ],     # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 158     "solrLocator" : {         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 158         "collection" : "collection1"     },     # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 202     "lowernames" : true,     # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 207     #  Tika parsers to be registered. If multiple parsers support the same MIME type,      #  the parser is chosen that is closest to the bottom in this list:     "parsers" : [         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 208         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 208             "parser" : "org.apache.tika.parser.asm.ClassParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 211         #  { parser : org.apache.tika.parser.AutoDetectParser }                               #  { parser : org.gagravarr.tika.OggParser, additionalSupportedMimeTypes : [audio/ogg] }         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 211             "parser" : "org.gagravarr.tika.FlacParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 212         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 212             "parser" : "org.apache.tika.parser.audio.AudioParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 213         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 213             "parser" : "org.apache.tika.parser.audio.MidiParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 214         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 214             "parser" : "org.apache.tika.parser.crypto.Pkcs7Parser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 215         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 215             "parser" : "org.apache.tika.parser.dwg.DWGParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 216         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 216             "parser" : "org.apache.tika.parser.epub.EpubParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 217         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 217             "parser" : "org.apache.tika.parser.executable.ExecutableParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 218         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 218             "parser" : "org.apache.tika.parser.feed.FeedParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 219         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 219             "parser" : "org.apache.tika.parser.font.AdobeFontMetricParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 220         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 220             "parser" : "org.apache.tika.parser.font.TrueTypeParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 221         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 221             "parser" : "org.apache.tika.parser.xml.XMLParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 222         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 222             "parser" : "org.apache.tika.parser.html.HtmlParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 223         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 223             "parser" : "org.apache.tika.parser.image.ImageParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 224         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 224             "parser" : "org.apache.tika.parser.image.PSDParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 225         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 225             "parser" : "org.apache.tika.parser.image.TiffParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 226         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 226             "parser" : "org.apache.tika.parser.iptc.IptcAnpaParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 227         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 227             "parser" : "org.apache.tika.parser.iwork.IWorkPackageParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 228         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 228             "parser" : "org.apache.tika.parser.jpeg.JpegParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 229         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 229             "parser" : "org.apache.tika.parser.mail.RFC822Parser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 230         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 230             "additionalSupportedMimeTypes" : [                 # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 230                 "message/x-emlx"             ],             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 230             "parser" : "org.apache.tika.parser.mbox.MboxParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 231         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 231             "parser" : "org.apache.tika.parser.microsoft.OfficeParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 232         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 232             "parser" : "org.apache.tika.parser.microsoft.TNEFParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 233         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 233             "parser" : "org.apache.tika.parser.microsoft.ooxml.OOXMLParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 234         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 234             "parser" : "org.apache.tika.parser.mp3.Mp3Parser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 235         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 235             "parser" : "org.apache.tika.parser.mp4.MP4Parser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 236         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 236             "parser" : "org.apache.tika.parser.hdf.HDFParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 237         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 237             "parser" : "org.apache.tika.parser.netcdf.NetCDFParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 238         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 238             "parser" : "org.apache.tika.parser.odf.OpenDocumentParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 239         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 239             "parser" : "org.apache.tika.parser.pdf.PDFParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 240         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 240             "parser" : "org.apache.tika.parser.pkg.CompressorParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 241         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 241             "parser" : "org.apache.tika.parser.pkg.PackageParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 242         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 242             "parser" : "org.apache.tika.parser.rtf.RTFParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 243         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 243             "parser" : "org.apache.tika.parser.txt.TXTParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 244         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 244             "parser" : "org.apache.tika.parser.video.FLVParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 245         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 245             "parser" : "org.apache.tika.parser.xml.DcXMLParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 246         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 246             "parser" : "org.apache.tika.parser.xml.FictionBookParser"         },         # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 247         {             # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 247             "parser" : "org.apache.tika.parser.chm.ChmParser"         }     ],     # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 201     #  various java.text.SimpleDateFormat     #  xpath : "/xhtml:html/xhtml:body/xhtml:div/descendant:node()"     "uprefix" : "ignored_" }

Stack Trace:
org.kitesdk.morphline.api.MorphlineCompilationException: Malformed / non-existent locale:  near: {
    # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 198
    "fmap" : {
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 198
        "content-type" : "content_type",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 198
        "content" : "text"
    },
    # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 160
    #  captureAttr : true # default is false
    "capture" : [
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 163
        #  twitter feed schema
        "user_friends_count",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 164
        "user_location",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 165
        "user_description",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 166
        "user_statuses_count",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 167
        "user_followers_count",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 168
        "user_name",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 169
        "user_screen_name",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 170
        "created_at",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 171
        "text",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 172
        "retweet_count",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 173
        "retweeted",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 174
        "in_reply_to_user_id",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 175
        "source",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 176
        "in_reply_to_status_id",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 177
        "media_url_https",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 178
        "expanded_url",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 181
        #  file metadata   
        "file_download_url",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 182
        "file_upload_url",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 183
        "file_scheme",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 184
        "file_host",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 185
        "file_port",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 186
        "file_path",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 187
        "file_name",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 188
        "file_length",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 189
        "file_last_modified",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 190
        "file_owner",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 191
        "file_group",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 192
        "file_permissions_user",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 193
        "file_permissions_group",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 194
        "file_permissions_other",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 195
        "file_permissions_stickybit"
    ],
    # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 199
    #  rename "content" field to "text" fields
    "dateFormats" : [
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 199
        "yyyy-MM-dd'T'HH:mm:ss",
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 199
        "yyyy-MM-dd"
    ],
    # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 158
    "solrLocator" : {
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 158
        "collection" : "collection1"
    },
    # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 202
    "lowernames" : true,
    # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 207
    #  Tika parsers to be registered. If multiple parsers support the same MIME type, 
    #  the parser is chosen that is closest to the bottom in this list:
    "parsers" : [
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 208
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 208
            "parser" : "org.apache.tika.parser.asm.ClassParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 211
        #  { parser : org.apache.tika.parser.AutoDetectParser }                      
        #  { parser : org.gagravarr.tika.OggParser, additionalSupportedMimeTypes : [audio/ogg] }
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 211
            "parser" : "org.gagravarr.tika.FlacParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 212
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 212
            "parser" : "org.apache.tika.parser.audio.AudioParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 213
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 213
            "parser" : "org.apache.tika.parser.audio.MidiParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 214
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 214
            "parser" : "org.apache.tika.parser.crypto.Pkcs7Parser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 215
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 215
            "parser" : "org.apache.tika.parser.dwg.DWGParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 216
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 216
            "parser" : "org.apache.tika.parser.epub.EpubParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 217
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 217
            "parser" : "org.apache.tika.parser.executable.ExecutableParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 218
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 218
            "parser" : "org.apache.tika.parser.feed.FeedParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 219
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 219
            "parser" : "org.apache.tika.parser.font.AdobeFontMetricParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 220
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 220
            "parser" : "org.apache.tika.parser.font.TrueTypeParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 221
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 221
            "parser" : "org.apache.tika.parser.xml.XMLParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 222
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 222
            "parser" : "org.apache.tika.parser.html.HtmlParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 223
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 223
            "parser" : "org.apache.tika.parser.image.ImageParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 224
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 224
            "parser" : "org.apache.tika.parser.image.PSDParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 225
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 225
            "parser" : "org.apache.tika.parser.image.TiffParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 226
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 226
            "parser" : "org.apache.tika.parser.iptc.IptcAnpaParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 227
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 227
            "parser" : "org.apache.tika.parser.iwork.IWorkPackageParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 228
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 228
            "parser" : "org.apache.tika.parser.jpeg.JpegParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 229
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 229
            "parser" : "org.apache.tika.parser.mail.RFC822Parser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 230
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 230
            "additionalSupportedMimeTypes" : [
                # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 230
                "message/x-emlx"
            ],
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 230
            "parser" : "org.apache.tika.parser.mbox.MboxParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 231
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 231
            "parser" : "org.apache.tika.parser.microsoft.OfficeParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 232
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 232
            "parser" : "org.apache.tika.parser.microsoft.TNEFParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 233
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 233
            "parser" : "org.apache.tika.parser.microsoft.ooxml.OOXMLParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 234
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 234
            "parser" : "org.apache.tika.parser.mp3.Mp3Parser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 235
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 235
            "parser" : "org.apache.tika.parser.mp4.MP4Parser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 236
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 236
            "parser" : "org.apache.tika.parser.hdf.HDFParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 237
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 237
            "parser" : "org.apache.tika.parser.netcdf.NetCDFParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 238
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 238
            "parser" : "org.apache.tika.parser.odf.OpenDocumentParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 239
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 239
            "parser" : "org.apache.tika.parser.pdf.PDFParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 240
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 240
            "parser" : "org.apache.tika.parser.pkg.CompressorParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 241
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 241
            "parser" : "org.apache.tika.parser.pkg.PackageParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 242
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 242
            "parser" : "org.apache.tika.parser.rtf.RTFParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 243
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 243
            "parser" : "org.apache.tika.parser.txt.TXTParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 244
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 244
            "parser" : "org.apache.tika.parser.video.FLVParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 245
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 245
            "parser" : "org.apache.tika.parser.xml.DcXMLParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 246
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 246
            "parser" : "org.apache.tika.parser.xml.FictionBookParser"
        },
        # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 247
        {
            # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 247
            "parser" : "org.apache.tika.parser.chm.ChmParser"
        }
    ],
    # /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J2/temp/solr.hadoop.MorphlineMapperTest_6AA3CDACAB3E11E8-001/tempDir-001/test-morphlines/solrCellDocumentTypes.conf: 201
    #  various java.text.SimpleDateFormat
    #  xpath : "/xhtml:html/xhtml:body/xhtml:div/descendant:node()"
    "uprefix" : "ignored_"
}
	at __randomizedtesting.SeedInfo.seed([6AA3CDACAB3E11E8:A0D7BDA0C0015899]:0)
	at org.apache.solr.morphlines.cell.SolrCellBuilder$SolrCell.getLocale(SolrCellBuilder.java:340)
	at org.apache.solr.morphlines.cell.SolrCellBuilder$SolrCell.<init>(SolrCellBuilder.java:166)
	at org.apache.solr.morphlines.cell.SolrCellBuilder.build(SolrCellBuilder.java:90)
	at org.kitesdk.morphline.base.AbstractCommand.buildCommand(AbstractCommand.java:302)
	at org.kitesdk.morphline.base.AbstractCommand.buildCommandChain(AbstractCommand.java:249)
	at org.kitesdk.morphline.stdlib.TryRulesBuilder$TryRules.<init>(TryRulesBuilder.java:83)
	at org.kitesdk.morphline.stdlib.TryRulesBuilder.build(TryRulesBuilder.java:59)
	at org.kitesdk.morphline.base.AbstractCommand.buildCommand(AbstractCommand.java:302)
	at org.kitesdk.morphline.base.AbstractCommand.buildCommandChain(AbstractCommand.java:249)
	at org.kitesdk.morphline.stdlib.Pipe.<init>(Pipe.java:46)
	at org.kitesdk.morphline.stdlib.PipeBuilder.build(PipeBuilder.java:40)
	at org.kitesdk.morphline.base.Compiler.compile(Compiler.java:126)
	at org.kitesdk.morphline.base.Compiler.compile(Compiler.java:55)
	at org.apache.solr.hadoop.morphline.MorphlineMapRunner.<init>(MorphlineMapRunner.java:158)
	at org.apache.solr.hadoop.morphline.MorphlineMapper.setup(MorphlineMapper.java:76)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
	at org.apache.hadoop.mrunit.mapreduce.MapDriver.run(MapDriver.java:137)
	at org.apache.solr.hadoop.MorphlineMapperTest.testMapper(MorphlineMapperTest.java:69)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.IllformedLocaleException: Empty subtag [at index 0]
	at java.util.Locale$Builder.setLanguageTag(Locale.java:2311)
	at org.apache.solr.morphlines.cell.SolrCellBuilder$SolrCell.getLocale(SolrCellBuilder.java:338)
	... 56 more


FAILED:  junit.framework.TestSuite.org.apache.solr.hadoop.MorphlineMapperTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.hadoop.MorphlineMapperTest:     1) Thread[id=14, name=Thread-2, state=TIMED_WAITING, group=TGRP-MorphlineMapperTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1033)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1326)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:282)         at org.apache.solr.hadoop.HeartBeater.run(HeartBeater.java:109)

Stack Trace:
com.carrotsearch.ra

[...truncated too long message...]

E11E8]-worker) [n:127.0.0.1:51573_ c:collection1 s:shard2 r:core_node5 x:collection1] o.a.h.h.s.n.FSNamesystem Stopping services started for standby state
   [junit4]   2> 1679428 INFO  (SUITE-MorphlineGoLiveMiniMRTest-seed#[6AA3CDACAB3E11E8]-worker) [n:127.0.0.1:51573_ c:collection1 s:shard2 r:core_node5 x:collection1] o.m.log Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0
   [junit4]   2> 1679530 INFO  (SUITE-MorphlineGoLiveMiniMRTest-seed#[6AA3CDACAB3E11E8]-worker) [n:127.0.0.1:51573_ c:collection1 s:shard2 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl Stopping JobHistoryServer metrics system...
   [junit4]   2> 1679533 ERROR (SUITE-MorphlineGoLiveMiniMRTest-seed#[6AA3CDACAB3E11E8]-worker) [n:127.0.0.1:51573_ c:collection1 s:shard2 r:core_node5 x:collection1] o.a.h.m.l.MethodMetric Error invoking method getBlocksTotal
   [junit4]   2> java.lang.reflect.InvocationTargetException
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:606)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MethodMetric$2.snapshot(MethodMetric.java:111)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MethodMetric.snapshot(MethodMetric.java:144)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MetricsRegistry.snapshot(MetricsRegistry.java:387)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.MetricsSourceBuilder$1.getMetrics(MetricsSourceBuilder.java:79)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMetrics(MetricsSourceAdapter.java:195)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.updateJmxCache(MetricsSourceAdapter.java:172)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.getMBeanInfo(MetricsSourceAdapter.java:151)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.getClassName(DefaultMBeanServerInterceptor.java:1804)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.safeGetClassName(DefaultMBeanServerInterceptor.java:1595)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.checkMBeanPermission(DefaultMBeanServerInterceptor.java:1813)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.exclusiveUnregisterMBean(DefaultMBeanServerInterceptor.java:430)
   [junit4]   2> 	at com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.unregisterMBean(DefaultMBeanServerInterceptor.java:415)
   [junit4]   2> 	at com.sun.jmx.mbeanserver.JmxMBeanServer.unregisterMBean(JmxMBeanServer.java:546)
   [junit4]   2> 	at org.apache.hadoop.metrics2.util.MBeans.unregister(MBeans.java:81)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stopMBeans(MetricsSourceAdapter.java:227)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSourceAdapter.stop(MetricsSourceAdapter.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stopSources(MetricsSystemImpl.java:461)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.stop(MetricsSystemImpl.java:212)
   [junit4]   2> 	at org.apache.hadoop.metrics2.impl.MetricsSystemImpl.shutdown(MetricsSystemImpl.java:592)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdownInstance(DefaultMetricsSystem.java:72)
   [junit4]   2> 	at org.apache.hadoop.metrics2.lib.DefaultMetricsSystem.shutdown(DefaultMetricsSystem.java:68)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.metrics.NameNodeMetrics.shutdown(NameNodeMetrics.java:145)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.NameNode.stop(NameNode.java:822)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1720)
   [junit4]   2> 	at org.apache.hadoop.hdfs.MiniDFSCluster.shutdown(MiniDFSCluster.java:1699)
   [junit4]   2> 	at org.apache.solr.hadoop.MorphlineGoLiveMiniMRTest.teardownClass(MorphlineGoLiveMiniMRTest.java:236)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]   2> 	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
   [junit4]   2> 	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]   2> 	at java.lang.reflect.Method.invoke(Method.java:606)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
   [junit4]   2> 	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
   [junit4]   2> 	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
   [junit4]   2> 	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: java.lang.NullPointerException
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlocksMap.size(BlocksMap.java:198)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.blockmanagement.BlockManager.getTotalBlocks(BlockManager.java:3291)
   [junit4]   2> 	at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlocksTotal(FSNamesystem.java:6223)
   [junit4]   2> 	... 53 more
   [junit4]   2> 1679554 INFO  (SUITE-MorphlineGoLiveMiniMRTest-seed#[6AA3CDACAB3E11E8]-worker) [n:127.0.0.1:51573_ c:collection1 s:shard2 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system stopped.
   [junit4]   2> 1679555 INFO  (SUITE-MorphlineGoLiveMiniMRTest-seed#[6AA3CDACAB3E11E8]-worker) [n:127.0.0.1:51573_ c:collection1 s:shard2 r:core_node5 x:collection1] o.a.h.m.i.MetricsSystemImpl JobHistoryServer metrics system shutdown complete.
   [junit4]   2> 1679556 INFO  (SUITE-MorphlineGoLiveMiniMRTest-seed#[6AA3CDACAB3E11E8]-worker) [n:127.0.0.1:51573_ c:collection1 s:shard2 r:core_node5 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/contrib/solr-map-reduce/test/J1/temp/solr.hadoop.MorphlineGoLiveMiniMRTest_6AA3CDACAB3E11E8-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene54), sim=DefaultSimilarity, locale=sr-Latn, timezone=Pacific/Efate
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_80 (64-bit)/cpus=4,threads=6,free=215294376,total=305659904
   [junit4]   2> NOTE: All tests run in this JVM: [MorphlineGoLiveMiniMRTest]
   [junit4] Completed [7/7 (3!)] on J1 in 1681.43s, 2 tests, 1 error <<< FAILURES!

[...truncated 14 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:801: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:738: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:253: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:469: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:534: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1444: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1000: There were test failures: 7 suites, 35 tests, 2 suite-level errors, 3 errors, 1 ignored [seed: 6AA3CDACAB3E11E8]

Total time: 312 minutes 57 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 1076 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/1076/

2 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=14907, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=14907, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:32961: Could not find collection : awholynewstresscollection_collection1_0
	at __randomizedtesting.SeedInfo.seed([FD3FB35516E95D91]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:576)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)


FAILED:  org.apache.solr.handler.TestReplicationHandler.doTestStressReplication

Error Message:
timed out waiting for collection1 startAt time to exceed: Sun Jan 17 04:15:23 GMT+00:00 2016

Stack Trace:
java.lang.AssertionError: timed out waiting for collection1 startAt time to exceed: Sun Jan 17 04:15:23 GMT+00:00 2016
	at __randomizedtesting.SeedInfo.seed([FD3FB35516E95D91:2694B39313C13422]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.handler.TestReplicationHandler.watchCoreStartAt(TestReplicationHandler.java:1419)
	at org.apache.solr.handler.TestReplicationHandler.doTestStressReplication(TestReplicationHandler.java:771)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10867 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/init-core-data-001
   [junit4]   2> 1921020 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[FD3FB35516E95D91]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1921020 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[FD3FB35516E95D91]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1921023 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1921024 INFO  (Thread-9278) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1921024 INFO  (Thread-9278) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1921124 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.ZkTestServer start zk server on port:33675
   [junit4]   2> 1921124 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1921125 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1921127 INFO  (zkCallback-972-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4068ba04 name:ZooKeeperConnection Watcher:127.0.0.1:33675 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1921128 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1921128 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1921128 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1921131 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1921131 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1921133 INFO  (zkCallback-973-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7f7fb059 name:ZooKeeperConnection Watcher:127.0.0.1:33675/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1921133 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1921133 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1921134 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1921136 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1921137 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1921139 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1921141 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1921141 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1921144 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1921144 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1921147 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1921147 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1921149 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1921149 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1921151 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1921152 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1921154 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1921154 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1921156 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1921156 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1921158 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1921158 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1921160 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1921161 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1921163 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1921163 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1921165 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1921165 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1921492 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores/collection1
   [junit4]   2> 1921493 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1921495 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7b4805c2{/,null,AVAILABLE}
   [junit4]   2> 1921498 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.e.j.s.ServerConnector Started ServerConnector@607eb588{HTTP/1.1}{127.0.0.1:32961}
   [junit4]   2> 1921498 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.e.j.s.Server Started @1924461ms
   [junit4]   2> 1921498 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores, hostPort=32961, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/tempDir-001/control/data}
   [junit4]   2> 1921498 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@7b3cb2c6
   [junit4]   2> 1921498 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001'
   [junit4]   2> 1921498 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1921499 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1921499 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1921499 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1921504 INFO  (zkCallback-974-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7910ea7c name:ZooKeeperConnection Watcher:127.0.0.1:33675/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1921505 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1921505 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1921506 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1921506 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/solr.xml
   [junit4]   2> 1921523 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores
   [junit4]   2> 1921523 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.CoreContainer New CoreContainer 1954882951
   [junit4]   2> 1921523 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001]
   [junit4]   2> 1921523 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/lib
   [junit4]   2> 1921524 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1921525 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1921526 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1921526 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1921526 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33675/solr
   [junit4]   2> 1921527 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1921527 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1921527 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1921529 INFO  (zkCallback-976-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@bd0eaa6 name:ZooKeeperConnection Watcher:127.0.0.1:33675 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1921529 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1921529 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1921531 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1921532 INFO  (zkCallback-977-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2adf989a name:ZooKeeperConnection Watcher:127.0.0.1:33675/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1921532 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1921533 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1921535 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1921540 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1921542 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1921544 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1921546 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1921548 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1921550 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1921551 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1921553 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:32961_
   [junit4]   2> 1921553 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:32961_
   [junit4]   2> 1921555 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1921557 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1921558 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1921559 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95224020988461060-127.0.0.1:32961_-n_0000000000
   [junit4]   2> 1921559 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:32961_
   [junit4]   2> 1921559 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1921560 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.Overseer Overseer (id=95224020988461060-127.0.0.1:32961_-n_0000000000) starting
   [junit4]   2> 1921562 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1921570 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1921571 INFO  (OverseerCollectionConfigSetProcessor-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1921571 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1921572 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1921609 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1921609 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1921610 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores
   [junit4]   2> 1921612 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {transient=false, dataDir=data/, configSetProperties=configsetprops.json, shard=, coreNodeName=, schema=schema.xml, loadOnStartup=true, config=solrconfig.xml, name=collection1, collection=control_collection}
   [junit4]   2> 1921612 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores/collection1
   [junit4]   2> 1921612 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1921613 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 1921613 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:32961_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1921613 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1921613 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1921615 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:32961_",
   [junit4]   2>   "base_url":"http://127.0.0.1:32961"} current state version: 0
   [junit4]   2> 1921616 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:32961_",
   [junit4]   2>   "base_url":"http://127.0.0.1:32961"}
   [junit4]   2> 1921616 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1921616 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1921617 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1921619 INFO  (zkCallback-977-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1922617 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1922617 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1922618 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1922618 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1922619 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1922619 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores/collection1'
   [junit4]   2> 1922619 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1922619 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1922621 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1922628 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1922642 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 1922672 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1922680 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1922947 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1922955 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1922957 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1922966 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1922969 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1922971 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1922972 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1922974 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 1922974 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1922974 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1922974 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores/collection1/data/]
   [junit4]   2> 1922974 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@166bcf1a
   [junit4]   2> 1922975 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores/collection1/data
   [junit4]   2> 1922975 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1922975 WARN  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1922975 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores/collection1/data/index
   [junit4]   2> 1922975 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=16, maxMergeAtOnceExplicit=39, maxMergedSegmentMB=52.0048828125, floorSegmentMB=0.50390625, forceMergeDeletesPctAllowed=6.93694183714036, segmentsPerTier=45.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2604247779116181
   [junit4]   2> 1922976 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@76cbaaaa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3531bbd4),segFN=segments_1,generation=1}
   [junit4]   2> 1922976 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1922977 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores/collection1/data/
   [junit4]   2> 1922977 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1922980 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1922980 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1922980 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1922980 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1922980 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1922980 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1922981 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1922981 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1922981 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1922981 WARN  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 1922984 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1922985 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1922986 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1922988 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1922991 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/properties,/schema,/admin/segments,/update/json,/config,/admin/threads,/update/json/docs,standard,/admin/luke,/admin/plugins,/update/csv,/update,/replication,/admin/logging,/admin/mbeans,/dump,/get,/admin/file,/admin/system,/admin/ping
   [junit4]   2> 1922992 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1922993 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1922993 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1922994 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1922994 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1922994 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=18, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 1922995 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@76cbaaaa lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3531bbd4),segFN=segments_1,generation=1}
   [junit4]   2> 1922995 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1922995 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@760752f2[collection1] main
   [junit4]   2> 1922995 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1922996 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1922996 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1922996 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1922996 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1922996 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1922997 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1922997 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1922997 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1922997 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1922998 INFO  (searcherExecutor-3359-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@760752f2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1922998 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1922998 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1922998 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1922998 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1523584337884217344
   [junit4]   2> 1923000 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1523584337884217344
   [junit4]   2> 1923000 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1923001 INFO  (coreLoadExecutor-3358-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1923001 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:32961 collection:control_collection shard:shard1
   [junit4]   2> 1923002 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1923006 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95224020988461060-core_node1-n_0000000000
   [junit4]   2> 1923006 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 1923008 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1923008 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1923008 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:32961/collection1/
   [junit4]   2> 1923008 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1923008 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1923008 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:32961/collection1/ has no replicas
   [junit4]   2> 1923009 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1923011 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1923013 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:32961/collection1/ shard1
   [junit4]   2> 1923014 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:32961",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1923115 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1923116 INFO  (zkCallback-977-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1923117 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1923118 INFO  (zkCallback-979-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4af05ce2 name:ZooKeeperConnection Watcher:127.0.0.1:33675/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1923118 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1923119 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1923119 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1923121 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1923121 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 1923121 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1923121 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1923122 INFO  (zkCallback-980-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@70973c50 name:ZooKeeperConnection Watcher:127.0.0.1:33675/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1923122 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1923122 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1923124 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x1524dbe191a0006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1923125 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 2
   [junit4]   2> 1923125 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1923164 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:32961/collection1/ and leader is http://127.0.0.1:32961/collection1/
   [junit4]   2> 1923164 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:32961
   [junit4]   2> 1923164 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1923164 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1923164 INFO  (coreZkRegister-3352-thread-1-processing-c:control_collection s:shard1 r:core_node1 x:collection1 n:127.0.0.1:32961_) [n:127.0.0.1:32961_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1923167 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:32961_",
   [junit4]   2>   "base_url":"http://127.0.0.1:32961"} current state version: 2
   [junit4]   2> 1923167 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:32961_",
   [junit4]   2>   "base_url":"http://127.0.0.1:32961"}
   [junit4]   2> 1923168 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 1923271 INFO  (zkCallback-977-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1923272 INFO  (zkCallback-979-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1923431 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001/cores/collection1
   [junit4]   2> 1923432 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001
   [junit4]   2> 1923432 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1923434 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17b82644{/,null,AVAILABLE}
   [junit4]   2> 1923434 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.e.j.s.ServerConnector Started ServerConnector@4cfe2598{HTTP/1.1}{127.0.0.1:60979}
   [junit4]   2> 1923434 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.e.j.s.Server Started @1926397ms
   [junit4]   2> 1923435 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=60979, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001/cores, solrconfig=solrconfig.xml, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/tempDir-001/jetty1}
   [junit4]   2> 1923435 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@7b3cb2c6
   [junit4]   2> 1923435 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001'
   [junit4]   2> 1923435 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1923435 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1923435 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1923436 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1923437 INFO  (zkCallback-981-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@214fa40f name:ZooKeeperConnection Watcher:127.0.0.1:33675/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1923438 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1923438 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1923439 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1923439 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001/solr.xml
   [junit4]   2> 1923453 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001/cores
   [junit4]   2> 1923454 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.CoreContainer New CoreContainer 544629357
   [junit4]   2> 1923454 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001]
   [junit4]   2> 1923454 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001/lib
   [junit4]   2> 1923454 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1923455 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1923456 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1923456 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1923456 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33675/solr
   [junit4]   2> 1923456 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1923456 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1923457 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1923458 INFO  (zkCallback-983-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5975ba5e name:ZooKeeperConnection Watcher:127.0.0.1:33675 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1923458 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1923458 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1923460 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1923461 INFO  (zkCallback-984-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1df9123e name:ZooKeeperConnection Watcher:127.0.0.1:33675/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1923461 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1923466 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1924472 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60979_
   [junit4]   2> 1924472 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60979_
   [junit4]   2> 1924474 INFO  (zkCallback-984-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1924474 INFO  (zkCallback-977-thread-1-processing-n:127.0.0.1:32961_) [n:127.0.0.1:32961_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1924474 INFO  (zkCallback-979-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1924475 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1924476 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95224020988461065-127.0.0.1:60979_-n_0000000001
   [junit4]   2> 1924477 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95224020988461060-127.0.0.1:32961_-n_0000000000 to know if I could be the leader
   [junit4]   2> 1924489 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1924489 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1924490 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001/cores
   [junit4]   2> 1924491 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {dataDir=data/, configSetProperties=configsetprops.json, config=solrconfig.xml, coreNodeName=, collection=collection1, name=collection1, loadOnStartup=true, schema=schema.xml, transient=false, shard=}
   [junit4]   2> 1924491 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001/cores/collection1
   [junit4]   2> 1924491 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1924493 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 1924493 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1924493 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[FD3FB35516E95D91]) [n:127.0.0.1:60979_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1924493 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1924494 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 1924495 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [collection1]
   [junit4]   2> 1924495 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:60979_",
   [junit4]   2>   "base_url":"http://127.0.0.1:60979"} current state version: 3
   [junit4]   2> 1924495 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Add data for [collection1] ver [0]
   [junit4]   2> 1924495 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1924495 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:60979_",
   [junit4]   2>   "base_url":"http://127.0.0.1:60979"}
   [junit4]   2> 1924495 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
   [junit4]   2> 1924495 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 1924598 INFO  (OverseerStateUpdate-95224020988461060-127.0.0.1:32961_-n_0000000000) [n:127.0.0.1:32961_    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 1924599 INFO  (zkCallback-984-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1924601 INFO  (zkCallback-984-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_    ] o.a.s.c.c.ZkStateReader Updating data for [collection1] from [0] to [1]
   [junit4]   2> 1925495 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1925495 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
   [junit4]   2> 1925496 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1925496 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/collection1]
   [junit4]   2> 1925497 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/collection1] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1925497 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_FD3FB35516E95D91-001/shard-1-001/cores/collection1'
   [junit4]   2> 1925497 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1925497 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1925499 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1925506 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1925521 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 1925550 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1925558 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1925809 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1925817 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1925819 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1925828 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1925831 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1925833 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1925834 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1925836 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 1925836 INFO  (coreLoadExecutor-3369-thread-1-processing-n:127.0.0.1:60979_) [n:127.0.0.1:60979_ c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]  

[...truncated too long message...]

ins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_FD3FB35516E95D91-001/solr-instance-026/./collection1/data
   [junit4]   2> 2840112 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_FD3FB35516E95D91-001/solr-instance-026/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_FD3FB35516E95D91-001/solr-instance-026/./collection1/data/index;done=false>>]
   [junit4]   2> 2840112 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_FD3FB35516E95D91-001/solr-instance-026/./collection1/data/index
   [junit4]   2> 2840115 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@712cfc94{/solr,null,UNAVAILABLE}
   [junit4]   2> 2840117 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@4193d246{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 2840117 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1468793681
   [junit4]   2> 2840117 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@7c03a5c9
   [junit4]   2> 2840117 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.u.DirectUpdateHandler2 closing DirectUpdateHandler2{commits=0,autocommits=0,soft autocommits=0,optimizes=0,rollbacks=0,expungeDeletes=0,docsPending=0,adds=0,deletesById=0,deletesByQuery=0,errors=0,cumulative_adds=0,cumulative_deletesById=0,cumulative_deletesByQuery=0,cumulative_errors=0}
   [junit4]   2> 2840118 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.u.SolrCoreState Closing SolrCoreState
   [junit4]   2> 2840118 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.u.DefaultSolrCoreState SolrCoreState ref count has reached 0 - closing IndexWriter
   [junit4]   2> 2840118 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.u.DefaultSolrCoreState closing IndexWriter with IndexWriterCloser
   [junit4]   2> 2840118 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.c.SolrCore [collection1] Closing main searcher on request.
   [junit4]   2> 2840119 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing MockDirectoryFactory - 2 directories currently being tracked
   [junit4]   2> 2840119 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_FD3FB35516E95D91-001/solr-instance-027/./collection1/data [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_FD3FB35516E95D91-001/solr-instance-027/./collection1/data;done=false>>]
   [junit4]   2> 2840119 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_FD3FB35516E95D91-001/solr-instance-027/./collection1/data
   [junit4]   2> 2840119 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.c.CachingDirectoryFactory looking to close /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_FD3FB35516E95D91-001/solr-instance-027/./collection1/data/index [CachedDir<<refCount=0;path=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_FD3FB35516E95D91-001/solr-instance-027/./collection1/data/index;done=false>>]
   [junit4]   2> 2840119 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_FD3FB35516E95D91-001/solr-instance-027/./collection1/data/index
   [junit4]   2> 2840122 INFO  (TEST-TestReplicationHandler.doTestRepeater-seed#[FD3FB35516E95D91]) [    x:collection1] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@3b0758e3{/solr,null,UNAVAILABLE}
   [junit4]   2> 2840123 INFO  (SUITE-TestReplicationHandler-seed#[FD3FB35516E95D91]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.handler.TestReplicationHandler_FD3FB35516E95D91-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarityProvider(queryNorm=false,coord=crazy): {}, locale=bg, timezone=Etc/GMT0
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_80 (64-bit)/cpus=4,threads=1,free=128172608,total=504889344
   [junit4]   2> NOTE: All tests run in this JVM: [SuggestComponentTest, HighlighterTest, FastVectorHighlighterTest, DistributedFacetPivotSmallAdvancedTest, TestHashPartitioner, TestRuleBasedAuthorizationPlugin, TestBulkSchemaAPI, DistributedIntervalFacetingTest, TestSolrConfigHandler, TestSchemaResource, CollectionTooManyReplicasTest, SecurityConfHandlerTest, SuggesterFSTTest, TestStressVersions, TestQuerySenderListener, TestUniqueKeyFieldResource, CloudExitableDirectoryReaderTest, ChaosMonkeyNothingIsSafeTest, DistributedMLTComponentTest, ShardRoutingCustomTest, DirectoryFactoryTest, DocExpirationUpdateProcessorFactoryTest, TestClusterStateMutator, SolrIndexConfigTest, SolrCloudExampleTest, TestLFUCache, SpellingQueryConverterTest, TestQueryTypes, TestOrdValues, TestPivotHelperCode, OpenCloseCoreStressTest, TestCloudInspectUtil, DistributedQueryComponentCustomSortTest, ZkCLITest, CloudMLTQParserTest, TestDefaultStatsCache, SolrPluginUtilsTest, UniqFieldsUpdateProcessorFactoryTest, VMParamsZkACLAndCredentialsProvidersTest, TestSimpleTrackingShardHandler, SmileWriterTest, TestReplicaProperties, TestMissingGroups, TestChildDocTransformer, DistributedExpandComponentTest, DeleteShardTest, SpellCheckCollatorTest, SortByFunctionTest, ZkControllerTest, TestSimpleQParserPlugin, HighlighterMaxOffsetTest, DocValuesTest, OverseerCollectionConfigSetProcessorTest, TestBM25SimilarityFactory, SpatialFilterTest, TestPartialUpdateDeduplication, ClusterStateUpdateTest, DistanceUnitsTest, TestMiniSolrCloudCluster, TestCoreContainer, TestReplicationHandlerBackup, TestTrie, TestFieldTypeResource, OverseerTaskQueueTest, BlockJoinFacetDistribTest, TestLMJelinekMercerSimilarityFactory, TestCodecSupport, ConvertedLegacyTest, TestExclusionRuleCollectionAccess, TestExceedMaxTermLength, TestConfigSetsAPI, TestAddFieldRealTimeGet, IndexBasedSpellCheckerTest, TestSolrCoreProperties, TestFileDictionaryLookup, WordBreakSolrSpellCheckerTest, TestConfigSetProperties, TestManagedSchemaFieldTypeResource, TestDistributedGrouping, TestShortCircuitedRequests, MinimalSchemaTest, TestXmlQParser, ForceLeaderTest, PreAnalyzedUpdateProcessorTest, NotRequiredUniqueKeyTest, TestHashQParserPlugin, DistanceFunctionTest, TestSchemaManager, TestSerializedLuceneMatchVersion, RequestLoggingTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, SyncSliceTest, OverseerTest, ShardRoutingTest, RecoveryZkTest, TestReplicationHandler]
   [junit4] Completed [202/565 (2!)] on J1 in 424.79s, 13 tests, 1 failure <<< FAILURES!

[...truncated 1269 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:801: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:738: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:534: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1444: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1000: There were test failures: 565 suites (7 ignored), 2259 tests, 1 error, 1 failure, 33 ignored (18 assumptions) [seed: FD3FB35516E95D91]

Total time: 260 minutes 10 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 1075 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/1075/

1 tests failed.
FAILED:  org.apache.solr.cloud.BasicDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:37382/collection1: Bad Request    request: http://127.0.0.1:41246/collection1/update?update.chain=distrib-dup-test-chain-explicit&update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A37382%2Fcollection1%2F&wt=javabin&version=2

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37382/collection1: Bad Request



request: http://127.0.0.1:41246/collection1/update?update.chain=distrib-dup-test-chain-explicit&update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A37382%2Fcollection1%2F&wt=javabin&version=2
	at __randomizedtesting.SeedInfo.seed([1817E361ACAC99E4:9043DCBB0250F41C]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:576)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:167)
	at org.apache.solr.BaseDistributedSearchTestCase.add(BaseDistributedSearchTestCase.java:512)
	at org.apache.solr.cloud.BasicDistributedZkTest.testUpdateProcessorsRunOnlyOnce(BasicDistributedZkTest.java:653)
	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:364)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:871)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:921)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:809)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:460)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:880)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:816)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:827)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 11068 lines...]
   [junit4] Suite: org.apache.solr.cloud.BasicDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/init-core-data-001
   [junit4]   2> 1884484 INFO  (SUITE-BasicDistributedZkTest-seed#[1817E361ACAC99E4]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1884489 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1884489 INFO  (Thread-3374) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1884489 INFO  (Thread-3374) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1884589 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.ZkTestServer start zk server on port:39969
   [junit4]   2> 1884590 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1884590 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1884594 INFO  (zkCallback-1754-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@55568b2 name:ZooKeeperConnection Watcher:127.0.0.1:39969 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1884594 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1884595 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1884595 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1884598 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1884599 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1884603 INFO  (zkCallback-1755-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@438b8942 name:ZooKeeperConnection Watcher:127.0.0.1:39969/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1884603 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1884604 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1884604 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1884607 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1884609 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1884611 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1884612 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1884612 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1884616 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1884616 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1884618 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1884618 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1884619 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1884620 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1884621 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1884621 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1884623 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1884623 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1884624 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1884624 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1884626 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1884626 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1884627 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1884627 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1884629 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1884629 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1884630 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1884631 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1885134 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores/collection1
   [junit4]   2> 1885136 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1885139 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4636109d{/,null,AVAILABLE}
   [junit4]   2> 1885139 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.e.j.s.ServerConnector Started ServerConnector@15237a99{HTTP/1.1}{127.0.0.1:60904}
   [junit4]   2> 1885139 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.e.j.s.Server Started @1888870ms
   [junit4]   2> 1885139 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostPort=60904, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/tempDir-001/control/data, hostContext=/}
   [junit4]   2> 1885140 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@7b3cb2c6
   [junit4]   2> 1885140 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001'
   [junit4]   2> 1885140 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1885140 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1885140 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1885141 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1885144 INFO  (zkCallback-1756-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@207a3426 name:ZooKeeperConnection Watcher:127.0.0.1:39969/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1885144 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1885144 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1885146 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1885146 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/solr.xml
   [junit4]   2> 1885162 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores
   [junit4]   2> 1885162 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.CoreContainer New CoreContainer 202555699
   [junit4]   2> 1885162 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001]
   [junit4]   2> 1885162 WARN  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/lib
   [junit4]   2> 1885162 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1885163 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1885164 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1885164 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1885164 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39969/solr
   [junit4]   2> 1885164 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1885164 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1885165 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1885167 INFO  (zkCallback-1758-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@75f1b685 name:ZooKeeperConnection Watcher:127.0.0.1:39969 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1885167 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1885167 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1885169 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1885171 INFO  (zkCallback-1759-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@41581898 name:ZooKeeperConnection Watcher:127.0.0.1:39969/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1885172 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1885174 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1885177 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1885180 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1885183 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1885187 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1885190 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1885192 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1885194 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1885195 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1885196 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60904_
   [junit4]   2> 1885197 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:60904_
   [junit4]   2> 1885199 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1885200 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1885201 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1885202 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95213991123484676-127.0.0.1:60904_-n_0000000000
   [junit4]   2> 1885202 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60904_
   [junit4]   2> 1885202 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1885204 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.Overseer Overseer (id=95213991123484676-127.0.0.1:60904_-n_0000000000) starting
   [junit4]   2> 1885206 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1885213 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1885214 INFO  (OverseerCollectionConfigSetProcessor-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1885214 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1885214 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1885241 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1885241 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1885242 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores
   [junit4]   2> 1885243 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {coreNodeName=, shard=, collection=control_collection, loadOnStartup=true, dataDir=data/, config=solrconfig.xml, configSetProperties=configsetprops.json, schema=schema.xml, transient=false, name=collection1}
   [junit4]   2> 1885243 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores/collection1
   [junit4]   2> 1885243 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1885245 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
   [junit4]   2> 1885245 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:60904_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1885245 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1885245 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1885247 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"down",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:60904_",
   [junit4]   2>   "base_url":"http://127.0.0.1:60904"} current state version: 0
   [junit4]   2> 1885248 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1885248 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"down",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:60904_",
   [junit4]   2>   "base_url":"http://127.0.0.1:60904"}
   [junit4]   2> 1885249 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1885249 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1885251 INFO  (zkCallback-1759-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1886249 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1886249 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1886249 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1886249 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1886250 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1886250 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores/collection1'
   [junit4]   2> 1886250 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1886250 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1886252 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1886258 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1886272 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 1886301 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1886314 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1886601 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1886610 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1886612 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1886628 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1886632 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1886637 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1886638 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1886640 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
   [junit4]   2> 1886640 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1886640 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1886640 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores/collection1/data/]
   [junit4]   2> 1886640 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ca63627
   [junit4]   2> 1886641 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores/collection1/data
   [junit4]   2> 1886641 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1886641 WARN  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1886642 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores/collection1/data/index
   [junit4]   2> 1886642 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@2768ffa4
   [junit4]   2> 1886645 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=RawDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5cc4aaec),segFN=segments_1,generation=1}
   [junit4]   2> 1886646 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1886666 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1886666 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1886667 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1886667 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1886667 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1886667 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1886667 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1886667 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1886667 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1886668 WARN  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 1886671 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1886671 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores/collection1/data/
   [junit4]   2> 1886672 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1886672 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1886674 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1886677 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1886683 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/segments,/get,/admin/luke,standard,/admin/ping,/admin/threads,/dump,/update/json,/admin/properties,/admin/mbeans,/admin/logging,/admin/plugins,/config,/update/csv,/schema,/update/json/docs,/update,/replication,/admin/file,/admin/system
   [junit4]   2> 1886686 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1886686 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1886686 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1886687 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1886688 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1886688 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=38, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=84.8212890625, floorSegmentMB=1.1318359375, forceMergeDeletesPctAllowed=27.90915906757699, segmentsPerTier=43.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 1886689 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=RawDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/index-NIOFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5cc4aaec),segFN=segments_1,generation=1}
   [junit4]   2> 1886689 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1886690 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@343a656c[collection1] main
   [junit4]   2> 1886690 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1886697 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1886697 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1886698 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1886698 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1886698 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1886700 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1886700 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1886700 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1886700 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1886702 INFO  (searcherExecutor-3391-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@343a656c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1886702 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1886702 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1886702 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1886702 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1523423860294156288
   [junit4]   2> 1886705 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 3.0ms to seed version buckets with highest version 1523423860294156288
   [junit4]   2> 1886705 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1886706 INFO  (coreLoadExecutor-3390-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1886707 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:60904 collection:control_collection shard:shard1
   [junit4]   2> 1886708 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1886712 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95213991123484676-core_node1-n_0000000000
   [junit4]   2> 1886713 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
   [junit4]   2> 1886715 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1886715 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1886715 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60904/collection1/
   [junit4]   2> 1886715 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1886715 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1886716 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:60904/collection1/ has no replicas
   [junit4]   2> 1886717 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1886720 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1886722 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60904/collection1/ shard1
   [junit4]   2> 1886723 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:60904",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1886747 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1886749 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1886749 INFO  (zkCallback-1761-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@20eded13 name:ZooKeeperConnection Watcher:127.0.0.1:39969/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1886749 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1886749 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1886749 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1886751 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1886826 INFO  (zkCallback-1761-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1886826 INFO  (zkCallback-1759-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1886874 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:60904/collection1/ and leader is http://127.0.0.1:60904/collection1/
   [junit4]   2> 1886874 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:60904
   [junit4]   2> 1886874 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1886874 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1886874 INFO  (coreZkRegister-3384-thread-1-processing-r:core_node1 s:shard1 c:control_collection x:collection1 n:127.0.0.1:60904_) [n:127.0.0.1:60904_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1886876 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"active",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:60904_",
   [junit4]   2>   "base_url":"http://127.0.0.1:60904"} current state version: 2
   [junit4]   2> 1886877 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"active",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:60904_",
   [junit4]   2>   "base_url":"http://127.0.0.1:60904"}
   [junit4]   2> 1886980 INFO  (zkCallback-1759-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1886980 INFO  (zkCallback-1761-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1887142 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores/collection1
   [junit4]   2> 1887144 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001
   [junit4]   2> 1887153 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1887177 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@47fb729{/,null,AVAILABLE}
   [junit4]   2> 1887177 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.e.j.s.ServerConnector Started ServerConnector@5cd1e70d{HTTP/1.1}{127.0.0.1:37382}
   [junit4]   2> 1887178 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.e.j.s.Server Started @1890909ms
   [junit4]   2> 1887178 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig.xml, hostPort=37382, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores, hostContext=/, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/tempDir-001/jetty1}
   [junit4]   2> 1887178 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@7b3cb2c6
   [junit4]   2> 1887178 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001'
   [junit4]   2> 1887178 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1887178 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1887179 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1887183 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1887184 INFO  (zkCallback-1762-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@18fcabbb name:ZooKeeperConnection Watcher:127.0.0.1:39969/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1887184 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1887184 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1887185 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1887185 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/solr.xml
   [junit4]   2> 1887209 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores
   [junit4]   2> 1887210 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.CoreContainer New CoreContainer 1974690352
   [junit4]   2> 1887210 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001]
   [junit4]   2> 1887210 WARN  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/lib
   [junit4]   2> 1887210 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1887212 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1887213 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1887213 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1887213 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:39969/solr
   [junit4]   2> 1887215 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1887215 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1887251 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1887290 INFO  (zkCallback-1764-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1da124d5 name:ZooKeeperConnection Watcher:127.0.0.1:39969 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1887290 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1887291 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1887293 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1887295 INFO  (zkCallback-1765-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@34b71c5c name:ZooKeeperConnection Watcher:127.0.0.1:39969/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1887295 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1887301 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1888305 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37382_
   [junit4]   2> 1888306 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:37382_
   [junit4]   2> 1888307 INFO  (zkCallback-1759-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1888307 INFO  (zkCallback-1761-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1888308 INFO  (zkCallback-1765-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1888308 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1888309 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95213991123484680-127.0.0.1:37382_-n_0000000001
   [junit4]   2> 1888309 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95213991123484676-127.0.0.1:60904_-n_0000000000 to know if I could be the leader
   [junit4]   2> 1888330 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1888330 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1888331 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores
   [junit4]   2> 1888332 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, coreNodeName=, dataDir=data/, collection=collection1, configSetProperties=configsetprops.json, shard=, schema=schema.xml, transient=false, config=solrconfig.xml, loadOnStartup=true}
   [junit4]   2> 1888332 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores/collection1
   [junit4]   2> 1888332 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1888334 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1888334 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1888336 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"down",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:37382_",
   [junit4]   2>   "base_url":"http://127.0.0.1:37382"} current state version: 3
   [junit4]   2> 1888336 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "roles":null,
   [junit4]   2>   "state":"down",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "node_name":"127.0.0.1:37382_",
   [junit4]   2>   "base_url":"http://127.0.0.1:37382"}
   [junit4]   2> 1888336 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1888336 INFO  (OverseerStateUpdate-95213991123484676-127.0.0.1:60904_-n_0000000000) [n:127.0.0.1:60904_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 1888338 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1888339 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
   [junit4]   2> 1888339 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:37382_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1888441 INFO  (zkCallback-1761-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1888441 INFO  (zkCallback-1765-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1888441 INFO  (zkCallback-1759-thread-1-processing-n:127.0.0.1:60904_) [n:127.0.0.1:60904_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1889339 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1889339 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
   [junit4]   2> 1889340 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1889340 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/collection1]
   [junit4]   2> 1889340 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/collection1] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1889340 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores/collection1'
   [junit4]   2> 1889340 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1889341 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1889342 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1889348 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1889362 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 1889391 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1889399 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1889652 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1889660 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1889662 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1889671 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1889674 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1889676 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1889677 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1889679 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0
   [junit4]   2> 1889679 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1889679 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1889679 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores/collection1/data/]
   [junit4]   2> 1889679 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3ca63627
   [junit4]   2> 1889680 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores/collection1/data
   [junit4]   2> 1889680 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores/collection1/data/index/
   [junit4]   2> 1889680 WARN  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1889681 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores/collection1/data/index
   [junit4]   2> 1889681 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@107bc95c
   [junit4]   2> 1889684 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=RawDirectoryWrapper(NIOFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/index-NIOFSDirectory-002 lockFactory=org.apache.lucene.store.NativeFSLockFactory@5cc4aaec),segFN=segments_1,generation=1}
   [junit4]   2> 1889684 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1889685 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores/collection1/data/
   [junit4]   2> 1889685 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:37382_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-1-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1889690 INFO  (coreLoadExecutor-3401-thread-1-processing-n:127.0.0.1:37382_) [n:127.0.0.1:37382_ c:collec

[...truncated too long message...]

 o.a.s.c.CachingDirectoryFactory Closing directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001/shard-4-001/cores/collection1/data/index
   [junit4]   2> 1963576 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@6893394c{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 1963576 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@150c8397{/,null,UNAVAILABLE}
   [junit4]   2> 1963578 INFO  (TEST-BasicDistributedZkTest.test-seed#[1817E361ACAC99E4]) [n:127.0.0.1:47355_ c:collection3 s:shard1 r:core_node4 x:collection3] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39969 39969
   [junit4]   2> 1963698 INFO  (Thread-3374) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:39969 39969
   [junit4]   2> 1963699 WARN  (Thread-3374) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/aliases.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/live_nodes
   [junit4]   2> 	7	/solr/collections
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 	4	/solr/overseer/queue
   [junit4]   2> 	4	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=BasicDistributedZkTest -Dtests.method=test -Dtests.seed=1817E361ACAC99E4 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=fr_CH -Dtests.timezone=Asia/Nicosia -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   79.2s J0 | BasicDistributedZkTest.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:37382/collection1: Bad Request
   [junit4]    > request: http://127.0.0.1:41246/collection1/update?update.chain=distrib-dup-test-chain-explicit&update.distrib=TOLEADER&distrib.from=http%3A%2F%2F127.0.0.1%3A37382%2Fcollection1%2F&wt=javabin&version=2
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([1817E361ACAC99E4:9043DCBB0250F41C]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:576)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:240)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:229)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:150)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:167)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase.add(BaseDistributedSearchTestCase.java:512)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.testUpdateProcessorsRunOnlyOnce(BasicDistributedZkTest.java:653)
   [junit4]    > 	at org.apache.solr.cloud.BasicDistributedZkTest.test(BasicDistributedZkTest.java:364)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:965)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:940)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1963704 INFO  (SUITE-BasicDistributedZkTest-seed#[1817E361ACAC99E4]-worker) [n:127.0.0.1:47355_ c:collection3 s:shard1 r:core_node4 x:collection3] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J0/temp/solr.cloud.BasicDistributedZkTest_1817E361ACAC99E4-001
   [junit4]   2> Jan 15, 2016 9:31:25 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene54): {n_d1=PostingsFormat(name=LuceneFixedGap), intDefault=Lucene50(blocksize=128), foo_b=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), regex_dup_B_s=PostingsFormat(name=LuceneFixedGap), n_l1=PostingsFormat(name=LuceneFixedGap), author_t=Lucene50(blocksize=128), text=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), genre_s=BlockTreeOrds(blocksize=128), price=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), regex_dup_A_s=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), foo_i=Lucene50(blocksize=128), a_t=PostingsFormat(name=LuceneFixedGap), SubjectTerms_mfacet=Lucene50(blocksize=128), foo_f=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), n_td1=Lucene50(blocksize=128), id=BlockTreeOrds(blocksize=128), n_f1=Lucene50(blocksize=128), sequence_i=BlockTreeOrds(blocksize=128), oddField_s=BlockTreeOrds(blocksize=128), range_facet_i_dv=PostingsFormat(name=LuceneFixedGap), n_tf1=PostingsFormat(name=LuceneFixedGap), inStock=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), val_i=BlockTreeOrds(blocksize=128), name=BlockTreeOrds(blocksize=128), rnd_b=BlockTreeOrds(blocksize=128), other_tl1=Lucene50(blocksize=128), n_tdt1=Lucene50(blocksize=128), range_facet_l_dv=BlockTreeOrds(blocksize=128), timestamp=PostingsFormat(name=LuceneFixedGap), cat=PostingsFormat(name=LuceneFixedGap), a_i1=PostingsFormat(name=LuceneFixedGap), foo_d=BlockTreeOrds(blocksize=128), n_dt1=Lucene50(blocksize=128), series_t=Lucene50(blocksize=128), range_facet_l=PostingsFormat(name=LuceneFixedGap), n_tl1=Lucene50(blocksize=128), multiDefault=PostingsFormat(name=LuceneFixedGap), _version_=Lucene50(blocksize=128), n_ti1=BlockTreeOrds(blocksize=128)}, docValues:{timestamp=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Direct), range_facet_l_dv=DocValuesFormat(name=Lucene54)}, sim=DefaultSimilarity, locale=fr_CH, timezone=Asia/Nicosia
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_80 (64-bit)/cpus=4,threads=1,free=291418576,total=501743616
   [junit4]   2> NOTE: All tests run in this JVM: [TestFunctionQuery, SortSpecParsingTest, TestRandomFaceting, PolyFieldTest, TestManagedSynonymFilterFactory, BlockJoinFacetSimpleTest, TestSolr4Spatial2, ParsingFieldUpdateProcessorsTest, TestSchemaNameResource, TestLuceneMatchVersion, TestLazyCores, DistributedVersionInfoTest, TestFieldTypeCollectionResource, TestMaxScoreQueryParser, TestConfigSetsAPIZkFailure, SyncSliceTest, TestRebalanceLeaders, TestRTGBase, TestRandomDVFaceting, SpatialRPTFieldTypeTest, JavabinLoaderTest, TestRTimerTree, DistributedDebugComponentTest, CleanupOldIndexTest, ResourceLoaderTest, SOLR749Test, AlternateDirectoryTest, TestAtomicUpdateErrorCases, TestFaceting, ReturnFieldsTest, TestJsonRequest, ActionThrottleTest, TestManagedSchema, TestShardHandlerFactory, BufferStoreTest, SignatureUpdateProcessorFactoryTest, ShardSplitTest, TriLevelCompositeIdRoutingTest, TestJoin, TestIBSimilarityFactory, PreAnalyzedFieldTest, EchoParamsTest, DistributedQueryElevationComponentTest, TestInitParams, LeaderFailoverAfterPartitionTest, TestSolrCLIRunExample, HdfsDirectoryFactoryTest, CurrencyFieldOpenExchangeTest, BasicAuthIntegrationTest, DistributedFacetPivotWhiteBoxTest, TestLRUCache, TestCloudManagedSchemaConcurrent, TestRemoteStreaming, TestRawResponseWriter, DocumentAnalysisRequestHandlerTest, TestMacros, TestFoldingMultitermQuery, TestTrieFacet, TestStressLucene, JsonLoaderTest, TestAuthenticationFramework, LeaderElectionIntegrationTest, TestDynamicLoading, TestHighFrequencyDictionaryFactory, TestSolrXml, TestMinMaxOnMultiValuedField, QueryEqualityTest, BasicDistributedZkTest]
   [junit4] Completed [256/565 (1!)] on J0 in 79.76s, 1 test, 1 error <<< FAILURES!

[...truncated 998 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:801: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:738: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:534: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1444: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1000: There were test failures: 565 suites (7 ignored), 2258 tests, 1 error, 33 ignored (18 assumptions) [seed: 1817E361ACAC99E4]

Total time: 221 minutes 58 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 1074 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/1074/

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=33805, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=33805, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:51792/i_q/p: collection already exists: awholynewstresscollection_collection1_5
	at __randomizedtesting.SeedInfo.seed([95EB1EF282912922]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)




Build Log:
[...truncated 11194 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/init-core-data-001
   [junit4]   2> 1963273 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[95EB1EF282912922]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 1963273 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[95EB1EF282912922]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /i_q/p
   [junit4]   2> 1963278 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1963278 INFO  (Thread-27858) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1963278 INFO  (Thread-27858) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1963378 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.ZkTestServer start zk server on port:56217
   [junit4]   2> 1963378 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1963379 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1963390 INFO  (zkCallback-909-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@17989f08 name:ZooKeeperConnection Watcher:127.0.0.1:56217 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1963390 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1963390 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1963390 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1963394 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1963394 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1963396 INFO  (zkCallback-910-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@53668b15 name:ZooKeeperConnection Watcher:127.0.0.1:56217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1963396 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1963396 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1963396 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1963399 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1963401 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1963402 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1963405 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1963405 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1963409 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1963409 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1963412 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1963413 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1963415 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1963415 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1963418 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1963418 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1963422 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1963422 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1963427 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1963427 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1963429 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1963430 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1963437 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1963437 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1963443 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1963443 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1963447 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1963447 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1963462 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1963463 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1963466 INFO  (zkCallback-911-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4fca1940 name:ZooKeeperConnection Watcher:127.0.0.1:56217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1963466 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1963466 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1963930 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores/collection1
   [junit4]   2> 1963931 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1963947 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@88864d6{/i_q/p,null,AVAILABLE}
   [junit4]   2> 1963953 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.e.j.s.ServerConnector Started ServerConnector@3ac9cb8c{SSL-http/1.1}{127.0.0.1:55461}
   [junit4]   2> 1963953 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.e.j.s.Server Started @1966606ms
   [junit4]   2> 1963953 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/i_q/p, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/tempDir-001/control/data, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores, hostPort=55461}
   [junit4]   2> 1963954 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@7b3cb2c6
   [junit4]   2> 1963954 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001'
   [junit4]   2> 1963954 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1963954 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1963954 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1963955 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1963957 INFO  (zkCallback-912-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7561d912 name:ZooKeeperConnection Watcher:127.0.0.1:56217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1963957 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1963958 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1963964 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1963964 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/solr.xml
   [junit4]   2> 1963981 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores
   [junit4]   2> 1963981 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.CoreContainer New CoreContainer 1846390021
   [junit4]   2> 1963981 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001]
   [junit4]   2> 1963982 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/lib
   [junit4]   2> 1963983 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1963986 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1963987 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1963987 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1963988 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56217/solr
   [junit4]   2> 1963988 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1963988 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1963988 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1963990 INFO  (zkCallback-914-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@12bbc73c name:ZooKeeperConnection Watcher:127.0.0.1:56217 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1963990 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1963991 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1963995 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1963998 INFO  (zkCallback-915-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b2c03d0 name:ZooKeeperConnection Watcher:127.0.0.1:56217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1963998 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1964000 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1964007 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1964011 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1964014 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1964021 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1964025 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1964029 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1964031 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1964032 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1964033 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:55461_i_q%2Fp
   [junit4]   2> 1964034 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:55461_i_q%2Fp
   [junit4]   2> 1964037 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1964039 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1964042 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1964043 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000
   [junit4]   2> 1964043 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:55461_i_q%2Fp
   [junit4]   2> 1964043 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1964047 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.Overseer Overseer (id=95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) starting
   [junit4]   2> 1964050 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1964062 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1964063 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1964063 INFO  (OverseerCollectionConfigSetProcessor-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 1964064 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1964087 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1964087 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1964089 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores
   [junit4]   2> 1964090 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {coreNodeName=, collection=control_collection, loadOnStartup=true, transient=false, dataDir=data/, schema=schema.xml, configSetProperties=configsetprops.json, config=solrconfig.xml, shard=, name=collection1}
   [junit4]   2> 1964090 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores/collection1
   [junit4]   2> 1964090 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1964093 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1964093 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1964096 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 1964096 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1964097 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1964098 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:55461/i_q/p",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "node_name":"127.0.0.1:55461_i_q%2Fp",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "numShards":"1"} current state version: 0
   [junit4]   2> 1964100 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:55461/i_q/p",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "node_name":"127.0.0.1:55461_i_q%2Fp",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "numShards":"1"}
   [junit4]   2> 1964101 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1964101 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1964104 INFO  (zkCallback-915-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1965098 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1965098 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1965099 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1965099 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1965100 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1965100 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores/collection1'
   [junit4]   2> 1965100 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1965100 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1965103 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1965112 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1965143 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 1965173 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1965181 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1965499 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1965519 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1965521 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1965539 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1965543 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1965546 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1965547 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1965549 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 1965549 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1965549 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1965549 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores/collection1/data/]
   [junit4]   2> 1965550 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@385e0377
   [junit4]   2> 1965550 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores/collection1/data
   [junit4]   2> 1965550 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1965551 WARN  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1965551 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores/collection1/data/index
   [junit4]   2> 1965551 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=49, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=0.9697265625, floorSegmentMB=0.720703125, forceMergeDeletesPctAllowed=20.70119545137434, segmentsPerTier=47.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.850076328410624
   [junit4]   2> 1965554 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/index-SimpleFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ba52c2a),segFN=segments_1,generation=1}
   [junit4]   2> 1965555 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1965559 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1965559 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1965560 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1965560 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1965560 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1965560 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1965560 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1965560 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1965560 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1965560 WARN  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 1965562 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores/collection1/data/
   [junit4]   2> 1965563 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1965564 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1965565 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1965567 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1965568 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1965572 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/threads,/update/json,/admin/luke,/replication,/dump,/get,standard,/admin/mbeans,/update/json/docs,/admin/properties,/admin/logging,/config,/admin/system,/admin/plugins,/update,/admin/file,/update/csv,/admin/segments,/admin/ping,/schema
   [junit4]   2> 1965573 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1965574 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1965574 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1965574 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1965574 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1965575 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@1ee0bedb
   [junit4]   2> 1965576 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(SimpleFSDirectory@/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/index-SimpleFSDirectory-001 lockFactory=org.apache.lucene.store.NativeFSLockFactory@1ba52c2a),segFN=segments_1,generation=1}
   [junit4]   2> 1965576 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 1965576 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@7abd564c[collection1] main
   [junit4]   2> 1965577 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 1965578 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1965578 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1965578 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1965578 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1965578 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1965579 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1965579 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1965579 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1965579 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1965579 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1965579 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1965579 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1965579 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1523256107992088576
   [junit4]   2> 1965580 INFO  (searcherExecutor-2631-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7abd564c[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1965582 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1523256107992088576
   [junit4]   2> 1965582 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1965583 INFO  (coreLoadExecutor-2630-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1965583 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:55461/i_q/p collection:control_collection shard:shard1
   [junit4]   2> 1965584 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1965588 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95203506598772741-core_node1-n_0000000000
   [junit4]   2> 1965588 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=180000
   [junit4]   2> 1965591 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1965593 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1965593 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1965593 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:55461/i_q/p/collection1/
   [junit4]   2> 1965593 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1965593 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:55461/i_q/p/collection1/ has no replicas
   [junit4]   2> 1965594 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1965597 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 1965599 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:55461/i_q/p/collection1/ shard1
   [junit4]   2> 1965600 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"https://127.0.0.1:55461/i_q/p",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1965600 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1965601 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1965603 INFO  (zkCallback-917-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@399c19e name:ZooKeeperConnection Watcher:127.0.0.1:56217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1965603 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1965603 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1965603 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1965607 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1965607 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 1965607 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1965608 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1965612 INFO  (zkCallback-918-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7e87360e name:ZooKeeperConnection Watcher:127.0.0.1:56217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1965613 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1965613 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1965616 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 1
   [junit4]   2> 1965616 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1965616 INFO  (zkCallback-915-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1965617 INFO  (zkCallback-917-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1965650 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:55461/i_q/p/collection1/ and leader is https://127.0.0.1:55461/i_q/p/collection1/
   [junit4]   2> 1965650 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:55461/i_q/p
   [junit4]   2> 1965650 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1965651 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1965651 INFO  (coreZkRegister-2624-thread-1-processing-c:control_collection s:shard1 x:collection1 n:127.0.0.1:55461_i_q%2Fp r:core_node1) [n:127.0.0.1:55461_i_q%2Fp c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1965653 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "base_url":"https://127.0.0.1:55461/i_q/p",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "node_name":"127.0.0.1:55461_i_q%2Fp",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "numShards":"2"} current state version: 2
   [junit4]   2> 1965654 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "base_url":"https://127.0.0.1:55461/i_q/p",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "node_name":"127.0.0.1:55461_i_q%2Fp",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "numShards":"2"}
   [junit4]   2> 1965654 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 1965760 INFO  (zkCallback-917-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1965761 INFO  (zkCallback-915-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1966055 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001/cores/collection1
   [junit4]   2> 1966076 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001
   [junit4]   2> 1966077 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 1966105 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6c950708{/i_q/p,null,AVAILABLE}
   [junit4]   2> 1966111 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.e.j.s.ServerConnector Started ServerConnector@2c00d5e9{SSL-http/1.1}{127.0.0.1:51792}
   [junit4]   2> 1966111 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.e.j.s.Server Started @1968764ms
   [junit4]   2> 1966111 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solrconfig=solrconfig.xml, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/tempDir-001/jetty1, hostPort=51792, hostContext=/i_q/p, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001/cores}
   [junit4]   2> 1966112 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@7b3cb2c6
   [junit4]   2> 1966112 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001'
   [junit4]   2> 1966112 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1966112 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1966112 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1966113 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1966115 INFO  (zkCallback-919-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@14c3c278 name:ZooKeeperConnection Watcher:127.0.0.1:56217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1966115 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1966116 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1966117 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1966117 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001/solr.xml
   [junit4]   2> 1966132 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001/cores
   [junit4]   2> 1966132 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.CoreContainer New CoreContainer 1937557899
   [junit4]   2> 1966132 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001]
   [junit4]   2> 1966132 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001/lib
   [junit4]   2> 1966133 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1966135 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1966136 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1966136 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1966136 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:56217/solr
   [junit4]   2> 1966136 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1966136 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1966137 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1966138 INFO  (zkCallback-921-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@253cf1cd name:ZooKeeperConnection Watcher:127.0.0.1:56217 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1966139 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1966140 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1966142 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1966144 INFO  (zkCallback-922-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3a6d68ec name:ZooKeeperConnection Watcher:127.0.0.1:56217/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1966145 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1966155 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1967175 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:51792_i_q%2Fp
   [junit4]   2> 1967175 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:51792_i_q%2Fp
   [junit4]   2> 1967176 INFO  (zkCallback-922-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1967176 INFO  (zkCallback-917-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1967176 INFO  (zkCallback-915-thread-1-processing-n:127.0.0.1:55461_i_q%2Fp) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1967178 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1967179 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95203506598772746-127.0.0.1:51792_i_q%2Fp-n_0000000001
   [junit4]   2> 1967179 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000 to know if I could be the leader
   [junit4]   2> 1967204 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1967204 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1967205 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001/cores
   [junit4]   2> 1967206 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {name=collection1, configSetProperties=configsetprops.json, collection=collection1, transient=false, config=solrconfig.xml, dataDir=data/, loadOnStartup=true, schema=schema.xml, coreNodeName=, shard=}
   [junit4]   2> 1967206 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001/cores/collection1
   [junit4]   2> 1967206 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 1967207 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 1967207 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[95EB1EF282912922]) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1967208 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1967208 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1967210 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 1967210 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch [collection1]
   [junit4]   2> 1967211 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Add data for [collection1] ver [0]
   [junit4]   2> 1967211 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:51792/i_q/p",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "node_name":"127.0.0.1:51792_i_q%2Fp",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "numShards":"2"} current state version: 3
   [junit4]   2> 1967211 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1967212 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:51792/i_q/p",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "node_name":"127.0.0.1:51792_i_q%2Fp",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "numShards":"2"}
   [junit4]   2> 1967212 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
   [junit4]   2> 1967212 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 1967315 INFO  (OverseerStateUpdate-95203506598772741-127.0.0.1:55461_i_q%2Fp-n_0000000000) [n:127.0.0.1:55461_i_q%2Fp    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 1967318 INFO  (zkCallback-922-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1967321 INFO  (zkCallback-922-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp    ] o.a.s.c.c.ZkStateReader Updating data for [collection1] from [0] to [1]
   [junit4]   2> 1968211 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1968211 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
   [junit4]   2> 1968212 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1968212 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/collection1]
   [junit4]   2> 1968213 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/collection1] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 1968213 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001/cores/collection1'
   [junit4]   2> 1968213 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 1968213 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 1968215 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1968224 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1968248 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 1968295 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1968303 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1968649 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1968659 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1968661 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1968673 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1968677 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1968679 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1968680 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1968682 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 1968682 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1968682 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1968682 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_95EB1EF282912922-001/shard-1-001/cores/collection1/data/]
   [junit4]   2> 1968682 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@385e0377
   [junit4]   2> 1968683 INFO  (coreLoadExecutor-2641-thread-1-processing-n:127.0.0.1:51792_i_q%2Fp) [n:127.0.0.1:51792_i_q%2Fp c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for 

[...truncated too long message...]

.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=it -Dtests.timezone=CST -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR    640s J1 | CollectionsAPIDistributedZkTest.test <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=33805, name=collection1, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:51792/i_q/p: collection already exists: awholynewstresscollection_collection1_5
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([95EB1EF282912922]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=33808, name=collection4, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:51792/i_q/p: Could not find collection : awholynewstresscollection_collection4_4
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([95EB1EF282912922]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:888)Throwable #3: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=33809, name=collection5, state=RUNNABLE, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:51792/i_q/p: collection already exists: awholynewstresscollection_collection5_8
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([95EB1EF282912922]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:575)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:230)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1100)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:871)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:807)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1574)
   [junit4]    > 	at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createCollection(AbstractFullDistribZkTestBase.java:1595)
   [junit4]    > 	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest$1CollectionThread.run(CollectionsAPIDistributedZkTest.java:881)
   [junit4]   2> 2603449 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[95EB1EF282912922]-worker) [n:127.0.0.1:38304_i_q%2Fp c:addReplicaColl s:shard2 r:core_node6 x:addReplicaColl_shard2_replica3] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=5, maxDocsPerChunk=7, blockSize=551), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=5, blockSize=551)), sim=RandomSimilarityProvider(queryNorm=false,coord=no): {}, locale=it, timezone=CST
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_80 (64-bit)/cpus=4,threads=1,free=67383416,total=468189184
   [junit4]   2> NOTE: All tests run in this JVM: [ConvertedLegacyTest, TestReqParamsAPI, CSVRequestHandlerTest, TestSolrDeletionPolicy2, TestHdfsUpdateLog, TestSurroundQueryParser, ChangedSchemaMergeTest, DistributedMLTComponentTest, HdfsChaosMonkeySafeLeaderTest, HttpPartitionTest, TestDocumentBuilder, TestClassNameShortening, SolrCmdDistributorTest, HdfsSyncSliceTest, DataDrivenBlockJoinTest, TestConfigSets, WordBreakSolrSpellCheckerTest, AnalyticsQueryTest, EnumFieldTest, TestNoOpRegenerator, TestRequestForwarding, AssignTest, TestLeaderElectionZkExpiry, DirectSolrSpellCheckerTest, HLLUtilTest, TestConfigOverlay, ZkSolrClientTest, MBeansHandlerTest, TestObjectReleaseTracker, DistribCursorPagingTest, FastVectorHighlighterTest, TestHashPartitioner, TestLRUStatsCache, TestSha256AuthenticationProvider, NotRequiredUniqueKeyTest, TestDistribDocBasedVersion, TestStressVersions, CheckHdfsIndexTest, BlockDirectoryTest, TestTrie, ShardRoutingTest, TestRandomRequestDistribution, TestBinaryResponseWriter, TimeZoneUtilsTest, ClusterStateUpdateTest, RecoveryAfterSoftCommitTest, DeleteLastCustomShardedReplicaTest, ExitableDirectoryReaderTest, SpellingQueryConverterTest, TestInitQParser, TestBM25SimilarityFactory, TestMiniSolrCloudClusterBase, TestLMJelinekMercerSimilarityFactory, TestQueryUtils, TestSmileRequest, TestDistributedStatsComponentCardinality, TestDistribIDF, TestReloadAndDeleteDocs, TestDFRSimilarityFactory, TestFastLRUCache, SpellCheckCollatorTest, IndexBasedSpellCheckerTest, TestUpdate, TestSolrQueryParserDefaultOperatorResource, TestStressUserVersions, SharedFSAutoReplicaFailoverUtilsTest, TestUseDocValuesAsStored, CollectionsAPIAsyncDistributedZkTest, OpenExchangeRatesOrgProviderTest, UpdateRequestProcessorFactoryTest, OverseerRolesTest, TestDynamicFieldCollectionResource, ShardRoutingCustomTest, NumericFieldsTest, TestPartialUpdateDeduplication, ChaosMonkeyNothingIsSafeTest, DistributedFacetPivotLargeTest, ZkStateReaderTest, TestJettySolrRunner, TestTrackingShardHandlerFactory, TestLFUCache, RestartWhileUpdatingTest, TestSortByMinMaxFunction, TestQueryTypes, TestSchemaSimilarityResource, TermsComponentTest, TestCloudPivotFacet, TestIntervalFaceting, OutOfBoxZkACLAndCredentialsProvidersTest, CollectionsAPIDistributedZkTest]
   [junit4] Completed [283/564 (1!)] on J1 in 641.11s, 1 test, 1 error <<< FAILURES!

[...truncated 916 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:801: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:738: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:532: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1444: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1000: There were test failures: 564 suites (7 ignored), 2253 tests, 1 error, 33 ignored (18 assumptions) [seed: 95EB1EF282912922]

Total time: 202 minutes 59 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-NightlyTests-5.x - Build # 1073 - Still Failing

Posted by Apache Jenkins Server <je...@builds.apache.org>.
Build: https://builds.apache.org/job/Lucene-Solr-NightlyTests-5.x/1073/

4 tests failed.
FAILED:  org.apache.solr.cloud.ChaosMonkeySafeLeaderTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=10854, name=Thread-9276, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=10854, name=Thread-9276, state=RUNNABLE, group=TGRP-ChaosMonkeySafeLeaderTest]
	at __randomizedtesting.SeedInfo.seed([FD9052E9725AF675:75C46D33DCA69B8D]:0)
Caused by: java.lang.AssertionError: 1
	at __randomizedtesting.SeedInfo.seed([FD9052E9725AF675]:0)
	at org.apache.solr.core.CachingDirectoryFactory.close(CachingDirectoryFactory.java:202)
	at org.apache.solr.core.SolrCore.close(SolrCore.java:1255)
	at org.apache.solr.core.SolrCores.close(SolrCores.java:125)
	at org.apache.solr.core.CoreContainer.shutdown(CoreContainer.java:582)
	at org.apache.solr.servlet.SolrDispatchFilter.destroy(SolrDispatchFilter.java:175)
	at org.eclipse.jetty.servlet.FilterHolder.destroyInstance(FilterHolder.java:173)
	at org.eclipse.jetty.servlet.FilterHolder.doStop(FilterHolder.java:151)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
	at org.eclipse.jetty.servlet.ServletHandler.doStop(ServletHandler.java:241)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
	at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:143)
	at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
	at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:73)
	at org.eclipse.jetty.server.session.SessionHandler.doStop(SessionHandler.java:127)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
	at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:143)
	at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
	at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:73)
	at org.eclipse.jetty.server.handler.ContextHandler.doStop(ContextHandler.java:835)
	at org.eclipse.jetty.servlet.ServletContextHandler.doStop(ServletContextHandler.java:215)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
	at org.eclipse.jetty.util.component.ContainerLifeCycle.stop(ContainerLifeCycle.java:143)
	at org.eclipse.jetty.util.component.ContainerLifeCycle.doStop(ContainerLifeCycle.java:162)
	at org.eclipse.jetty.server.handler.AbstractHandler.doStop(AbstractHandler.java:73)
	at org.eclipse.jetty.server.Server.doStop(Server.java:456)
	at org.eclipse.jetty.util.component.AbstractLifeCycle.stop(AbstractLifeCycle.java:89)
	at org.apache.solr.client.solrj.embedded.JettySolrRunner.stop(JettySolrRunner.java:444)
	at org.apache.solr.cloud.ChaosMonkey.kill(ChaosMonkey.java:232)
	at org.apache.solr.cloud.ChaosMonkey.kill(ChaosMonkey.java:242)
	at org.apache.solr.cloud.ChaosMonkey.killJetty(ChaosMonkey.java:175)
	at org.apache.solr.cloud.ChaosMonkey.killRandomShard(ChaosMonkey.java:336)
	at org.apache.solr.cloud.ChaosMonkey.killRandomShard(ChaosMonkey.java:321)
	at org.apache.solr.cloud.ChaosMonkey$2.run(ChaosMonkey.java:519)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
ObjectTracker found 2 object(s) that were not released!!! [SolrCore, MMapDirectory]

Stack Trace:
java.lang.AssertionError: ObjectTracker found 2 object(s) that were not released!!! [SolrCore, MMapDirectory]
	at __randomizedtesting.SeedInfo.seed([FD9052E9725AF675]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNull(Assert.java:551)
	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:228)
	at sun.reflect.GeneratedMethodAccessor40.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:606)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1764)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:834)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:367)
	at java.lang.Thread.run(Thread.java:745)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
1 thread leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest:     1) Thread[id=10782, name=org.eclipse.jetty.server.session.HashSessionManager@38de084bTimer, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest: 
   1) Thread[id=10782, name=org.eclipse.jetty.server.session.HashSessionManager@38de084bTimer, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([FD9052E9725AF675]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.ChaosMonkeySafeLeaderTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=10782, name=org.eclipse.jetty.server.session.HashSessionManager@38de084bTimer, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=10782, name=org.eclipse.jetty.server.session.HashSessionManager@38de084bTimer, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([FD9052E9725AF675]:0)




Build Log:
[...truncated 10338 lines...]
   [junit4] Suite: org.apache.solr.cloud.ChaosMonkeySafeLeaderTest
   [junit4]   2> Creating dataDir: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/init-core-data-001
   [junit4]   2> 463255 INFO  (SUITE-ChaosMonkeySafeLeaderTest-seed#[FD9052E9725AF675]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 463256 INFO  (SUITE-ChaosMonkeySafeLeaderTest-seed#[FD9052E9725AF675]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /t_dj/
   [junit4]   2> 463261 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 463262 INFO  (Thread-9181) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 463262 INFO  (Thread-9181) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 463362 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.ZkTestServer start zk server on port:43709
   [junit4]   2> 463362 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 463363 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 463365 INFO  (zkCallback-227-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5bc935f6 name:ZooKeeperConnection Watcher:127.0.0.1:43709 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 463365 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 463365 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 463365 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 463367 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 463368 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 463370 INFO  (zkCallback-228-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4decee20 name:ZooKeeperConnection Watcher:127.0.0.1:43709/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 463370 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 463371 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 463371 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 463374 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 463376 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 463378 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 463380 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 463380 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 463383 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 463383 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 463385 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 463385 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 463387 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 463387 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 463389 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 463389 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 463392 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 463392 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 463393 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 463393 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 463395 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 463396 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 463402 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 463402 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 463403 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 463404 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 463405 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractZkTestCase put /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 463406 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 463739 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1
   [junit4]   2> 463741 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 463743 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@df04ef7{/t_dj,null,AVAILABLE}
   [junit4]   2> 463749 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.e.j.s.ServerConnector Started ServerConnector@1d2ebe5b{HTTP/1.1}{127.0.0.1:49318}
   [junit4]   2> 463749 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.e.j.s.Server Started @466840ms
   [junit4]   2> 463749 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/t_dj, hostPort=49318, coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/tempDir-001/control/data}
   [junit4]   2> 463750 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4dfd245f
   [junit4]   2> 463750 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001'
   [junit4]   2> 463750 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 463750 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 463751 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 463751 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 463753 INFO  (zkCallback-229-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@23d0c01a name:ZooKeeperConnection Watcher:127.0.0.1:43709/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 463753 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 463753 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 463755 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 463755 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/solr.xml
   [junit4]   2> 463775 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores
   [junit4]   2> 463775 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.CoreContainer New CoreContainer 612910795
   [junit4]   2> 463775 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001]
   [junit4]   2> 463775 WARN  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/lib
   [junit4]   2> 463776 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 463777 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 463778 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 463778 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 463778 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43709/solr
   [junit4]   2> 463778 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 463778 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 463778 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 463780 INFO  (zkCallback-231-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4dea2663 name:ZooKeeperConnection Watcher:127.0.0.1:43709 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 463780 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 463781 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 463783 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 463784 INFO  (zkCallback-232-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@58022901 name:ZooKeeperConnection Watcher:127.0.0.1:43709/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 463784 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 463785 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 463787 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 463791 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 463795 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 463797 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 463802 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 463805 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 463806 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 463807 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 463809 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:49318_t_dj
   [junit4]   2> 463809 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:49318_t_dj
   [junit4]   2> 463811 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 463812 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 463815 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 463816 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95197624551079940-127.0.0.1:49318_t_dj-n_0000000000
   [junit4]   2> 463817 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:49318_t_dj
   [junit4]   2> 463817 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 463819 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.Overseer Overseer (id=95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) starting
   [junit4]   2> 463822 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 463829 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 463831 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 463831 INFO  (OverseerCollectionConfigSetProcessor-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.OverseerTaskProcessor Process current queue of overseer operations
   [junit4]   2> 463832 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 463847 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 463847 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 463849 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores
   [junit4]   2> 463850 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {coreNodeName=, dataDir=data/, loadOnStartup=true, shard=, collection=control_collection, configSetProperties=configsetprops.json, name=collection1, transient=false, schema=schema.xml, config=solrconfig.xml}
   [junit4]   2> 463850 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1
   [junit4]   2> 463850 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 463851 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 463852 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:49318_t_dj    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 463853 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 463853 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 463856 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49318/t_dj",
   [junit4]   2>   "node_name":"127.0.0.1:49318_t_dj",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "numShards":"1"} current state version: 0
   [junit4]   2> 463856 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 463857 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49318/t_dj",
   [junit4]   2>   "node_name":"127.0.0.1:49318_t_dj",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "numShards":"1"}
   [junit4]   2> 463857 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 463858 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 463861 INFO  (zkCallback-232-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 464857 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 464857 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 464857 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 464857 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 464858 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 464858 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1'
   [junit4]   2> 464858 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 464858 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 464860 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 464867 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 464883 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 464916 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 464923 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 465165 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 465166 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 465168 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 465171 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 465197 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 465197 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 465198 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
   [junit4]   2> 465198 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1], dataDir=[/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1/data/]
   [junit4]   2> 465198 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@3e4d106f
   [junit4]   2> 465200 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1/data
   [junit4]   2> 465200 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1/data/index/
   [junit4]   2> 465200 WARN  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 465201 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1/data/index
   [junit4]   2> 465201 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=11, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.18342186312589917]
   [junit4]   2> 465209 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 465209 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 465210 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/../../../../../../../../../../x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1/data/
   [junit4]   2> 465217 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 465217 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 465217 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 465217 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 465217 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 465217 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 465218 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 465218 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 465218 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 465218 WARN  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,args = {defaults={a=A,b=B}}}
   [junit4]   2> 465221 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 465223 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 465224 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 465226 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 465231 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /update/json,/dump,standard,/update/csv,/admin/mbeans,/admin/ping,/admin/properties,/admin/segments,/config,/admin/system,/admin/luke,/update/json/docs,/admin/file,/get,/schema,/replication,/admin/threads,/admin/logging,/admin/plugins,/update
   [junit4]   2> 465232 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 465232 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 465232 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 465233 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: if uncommited for 15000ms; 
   [junit4]   2> 465233 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 465234 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=41, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3436575813588232]
   [junit4]   2> 465234 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/control-001/cores/collection1/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 465234 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrDeletionPolicy newest commit generation = 1
   [junit4]   2> 465235 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@3038a16[collection1] main
   [junit4]   2> 465235 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/control_collection]
   [junit4]   2> 465235 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/control_collection] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 465236 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 465236 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 465236 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 465236 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 465236 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 465236 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 465237 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 465237 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 465237 INFO  (searcherExecutor-685-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@3038a16[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 465237 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 465238 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 465238 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 465238 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1523161994888216576
   [junit4]   2> 465240 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1523161994888216576
   [junit4]   2> 465240 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 465240 INFO  (coreLoadExecutor-684-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 465241 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:49318/t_dj collection:control_collection shard:shard1
   [junit4]   2> 465242 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 465245 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/95197624551079940-core_node1-n_0000000000
   [junit4]   2> 465245 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard=shard1 and weAreReplacement=false and leaderVoteWait=10000
   [junit4]   2> 465247 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 465247 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 465247 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:49318/t_dj/collection1/
   [junit4]   2> 465247 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 465247 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:49318/t_dj/collection1/ has no replicas
   [junit4]   2> 465247 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 465248 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 465253 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContextBase Creating leader registration node
   [junit4]   2> 465255 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:49318/t_dj/collection1/ shard1
   [junit4]   2> 465255 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:49318/t_dj",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 465353 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 465354 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 465356 INFO  (zkCallback-234-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@29e982be name:ZooKeeperConnection Watcher:127.0.0.1:43709/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 465356 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 465356 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 465356 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 465358 INFO  (zkCallback-232-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 465358 INFO  (zkCallback-234-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 465359 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 465407 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:49318/t_dj/collection1/ and leader is http://127.0.0.1:49318/t_dj/collection1/
   [junit4]   2> 465407 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:49318/t_dj
   [junit4]   2> 465407 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 465407 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 465407 INFO  (coreZkRegister-678-thread-1-processing-c:control_collection s:shard1 r:core_node1 n:127.0.0.1:49318_t_dj x:collection1) [n:127.0.0.1:49318_t_dj c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 465410 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49318/t_dj",
   [junit4]   2>   "node_name":"127.0.0.1:49318_t_dj",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "numShards":"3"} current state version: 2
   [junit4]   2> 465411 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:49318/t_dj",
   [junit4]   2>   "node_name":"127.0.0.1:49318_t_dj",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "numShards":"3"}
   [junit4]   2> 465514 INFO  (zkCallback-234-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 465514 INFO  (zkCallback-232-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 465722 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001/cores/collection1
   [junit4]   2> 465723 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001
   [junit4]   2> 465723 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.e.j.s.Server jetty-9.2.13.v20150730
   [junit4]   2> 465730 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2c89dc26{/t_dj,null,AVAILABLE}
   [junit4]   2> 465730 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.e.j.s.ServerConnector Started ServerConnector@ed459a2{HTTP/1.1}{127.0.0.1:35699}
   [junit4]   2> 465730 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.e.j.s.Server Started @468821ms
   [junit4]   2> 465730 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {coreRootDirectory=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001/cores, solr.data.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostPort=35699, hostContext=/t_dj}
   [junit4]   2> 465731 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4dfd245f
   [junit4]   2> 465731 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001'
   [junit4]   2> 465731 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 465731 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 465731 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 465746 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 465749 INFO  (zkCallback-235-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@70bb9757 name:ZooKeeperConnection Watcher:127.0.0.1:43709/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 465749 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 465749 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 465754 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 465754 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001/solr.xml
   [junit4]   2> 465774 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.CorePropertiesLocator Config-defined core root directory: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001/cores
   [junit4]   2> 465774 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.CoreContainer New CoreContainer 1551091913
   [junit4]   2> 465774 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001]
   [junit4]   2> 465775 WARN  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.CoreContainer Couldn't add files from /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001/lib to classpath: /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001/lib
   [junit4]   2> 465775 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 465777 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 465777 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 465777 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 465777 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43709/solr
   [junit4]   2> 465777 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 465777 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 465793 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 465797 INFO  (zkCallback-237-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@750697d name:ZooKeeperConnection Watcher:127.0.0.1:43709 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 465797 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 465798 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 465808 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 465821 INFO  (zkCallback-238-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3437cb0f name:ZooKeeperConnection Watcher:127.0.0.1:43709/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 465821 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 465828 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 466836 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35699_t_dj
   [junit4]   2> 466837 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:35699_t_dj
   [junit4]   2> 466838 INFO  (zkCallback-232-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 466838 INFO  (zkCallback-234-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 466838 INFO  (zkCallback-238-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.c.ZkStateReader A live node change: [WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes], has occurred - updating... (live nodes size: [1])
   [junit4]   2> 466841 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 466842 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/95197624551079944-127.0.0.1:35699_t_dj-n_0000000001
   [junit4]   2> 466843 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/95197624551079940-127.0.0.1:49318_t_dj-n_0000000000 to know if I could be the leader
   [junit4]   2> 466861 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 466861 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 466862 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.CorePropertiesLocator Looking for core definitions underneath /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001/cores
   [junit4]   2> 466863 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.CoreDescriptor Created CoreDescriptor: {dataDir=data/, shard=, name=collection1, transient=false, loadOnStartup=true, configSetProperties=configsetprops.json, config=solrconfig.xml, schema=schema.xml, collection=collection1, coreNodeName=}
   [junit4]   2> 466863 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.CorePropertiesLocator Found core collection1 in /x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001/cores/collection1
   [junit4]   2> 466863 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions
   [junit4]   2> 466864 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.s.SolrDispatchFilter user.dir=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 466864 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 466864 INFO  (TEST-ChaosMonkeySafeLeaderTest.test-seed#[FD9052E9725AF675]) [n:127.0.0.1:35699_t_dj    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 466864 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 466866 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35699/t_dj",
   [junit4]   2>   "node_name":"127.0.0.1:35699_t_dj",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "numShards":"3"} current state version: 3
   [junit4]   2> 466866 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 466867 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.o.ReplicaMutator Update state numShards=3 message={
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:35699/t_dj",
   [junit4]   2>   "node_name":"127.0.0.1:35699_t_dj",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "operation":"state",
   [junit4]   2>   "numShards":"3"}
   [junit4]   2> 466867 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 466867 INFO  (OverseerStateUpdate-95197624551079940-127.0.0.1:49318_t_dj-n_0000000000) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 466971 INFO  (zkCallback-234-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 466971 INFO  (zkCallback-232-thread-1-processing-n:127.0.0.1:49318_t_dj) [n:127.0.0.1:49318_t_dj    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 466971 INFO  (zkCallback-238-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json], has occurred - updating... (live nodes size: [2])
   [junit4]   2> 467867 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 467867 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
   [junit4]   2> 467868 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 467868 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from: [/collections/collection1]
   [junit4]   2> 467868 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.c.ZkStateReader path=[/collections/collection1] [configName]=[conf1] specified config exists in ZooKeeper
   [junit4]   2> 467868 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1/temp/solr.cloud.ChaosMonkeySafeLeaderTest_FD9052E9725AF675-001/shard-1-001/cores/collection1'
   [junit4]   2> 467869 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.SolrResourceLoader JNDI not configured for solr (NoInitialContextEx)
   [junit4]   2> 467869 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 467871 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 467877 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 467892 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 5.5.0
   [junit4]   2> 467923 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.SolrConfig Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 467930 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 468146 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 468147 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 468148 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 468152 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 468172 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build/solr-core/test/J1
   [junit4]   2> 468172 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 468172 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
   [junit4]   2> 468172 INFO  (coreLoadExecutor-695-thread-1-processing-n:127.0.0.1:35699_t_dj) [n:127.0.0.1:35699_t_dj c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [

[...truncated too long message...]

pache.solr.core.CoreContainer$1.call(CoreContainer.java:458)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:262)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:232)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 
   [junit4]   2> Jan 12, 2016 12:10:53 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> Jan 12, 2016 12:11:13 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest: 
   [junit4]   2>    1) Thread[id=10782, name=org.eclipse.jetty.server.session.HashSessionManager@38de084bTimer, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
   [junit4]   2>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
   [junit4]   2>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Jan 12, 2016 12:11:13 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=10782, name=org.eclipse.jetty.server.session.HashSessionManager@38de084bTimer, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2> Jan 12, 2016 12:11:16 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=10782, name=org.eclipse.jetty.server.session.HashSessionManager@38de084bTimer, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
   [junit4]   2>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
   [junit4]   2>         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]   2>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]   2>         at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene54): {a_i=PostingsFormat(name=LuceneVarGapDocFreqInterval), id=PostingsFormat(name=LuceneVarGapDocFreqInterval), rnd_b=PostingsFormat(name=LuceneVarGapDocFreqInterval), a_t=FSTOrd50, _version_=PostingsFormat(name=Memory doPackFST= true)}, docValues:{}, sim=DefaultSimilarity, locale=ja, timezone=US/Mountain
   [junit4]   2> NOTE: Linux 3.13.0-52-generic amd64/Oracle Corporation 1.7.0_80 (64-bit)/cpus=4,threads=2,free=104598952,total=429391872
   [junit4]   2> NOTE: All tests run in this JVM: [FastVectorHighlighterTest, LoggingHandlerTest, MBeansHandlerTest, TestCustomSort, TestDistributedStatsComponentCardinality, DOMUtilTest, HdfsWriteToMultipleCollectionsTest, MinimalSchemaTest, ChaosMonkeyNothingIsSafeTest, SolrXmlInZkTest, UniqFieldsUpdateProcessorFactoryTest, BasicAuthIntegrationTest, TestReloadAndDeleteDocs, WordBreakSolrSpellCheckerTest, TestExactSharedStatsCache, IndexBasedSpellCheckerTest, TestSolrCloudWithKerberosAlt, SpellCheckComponentTest, TestCustomDocTransformer, TestBlendedInfixSuggestions, TestSurroundQueryParser, TestRequestForwarding, ChaosMonkeySafeLeaderTest]
   [junit4]   2> NOTE: download the large Jenkins line-docs file by running 'ant get-jenkins-line-docs' in the lucene directory.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ChaosMonkeySafeLeaderTest -Dtests.seed=FD9052E9725AF675 -Dtests.multiplier=2 -Dtests.nightly=true -Dtests.slow=true -Dtests.linedocsfile=/x1/jenkins/lucene-data/enwiki.random.lines.txt -Dtests.locale=ja -Dtests.timezone=US/Mountain -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | ChaosMonkeySafeLeaderTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: ObjectTracker found 2 object(s) that were not released!!! [SolrCore, MMapDirectory]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FD9052E9725AF675]:0)
   [junit4]    > 	at org.apache.solr.SolrTestCaseJ4.afterClass(SolrTestCaseJ4.java:228)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.cloud.ChaosMonkeySafeLeaderTest: 
   [junit4]    >    1) Thread[id=10782, name=org.eclipse.jetty.server.session.HashSessionManager@38de084bTimer, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
   [junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
   [junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FD9052E9725AF675]:0)Throwable #3: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=10782, name=org.eclipse.jetty.server.session.HashSessionManager@38de084bTimer, state=TIMED_WAITING, group=TGRP-ChaosMonkeySafeLeaderTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:226)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2082)
   [junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1090)
   [junit4]    >         at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:807)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1068)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([FD9052E9725AF675]:0)
   [junit4] Completed [74/563 (1!)] on J1 in 203.89s, 1 test, 1 failure, 3 errors <<< FAILURES!

[...truncated 1504 lines...]
BUILD FAILED
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:801: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:738: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/build.xml:59: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/build.xml:233: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/solr/common-build.xml:526: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1444: The following error occurred while executing this line:
/x1/jenkins/jenkins-slave/workspace/Lucene-Solr-NightlyTests-5.x/lucene/common-build.xml:1000: There were test failures: 563 suites (7 ignored), 2236 tests, 3 suite-level errors, 1 error, 1403 ignored (7 assumptions) [seed: FD9052E9725AF675]

Total time: 166 minutes 32 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any