You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2015/08/08 16:43:53 UTC

[JENKINS-EA] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_60-ea-b24) - Build # 13779 - Failure!

Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13779/
Java: 64bit/jdk1.8.0_60-ea-b24 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CdcrReplicationHandlerTest.doTest

Error Message:
Captured an uncaught exception in thread: Thread[id=3409, name=RecoveryThread-source_collection_shard1_replica2, state=RUNNABLE, group=TGRP-CdcrReplicationHandlerTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3409, name=RecoveryThread-source_collection_shard1_replica2, state=RUNNABLE, group=TGRP-CdcrReplicationHandlerTest]
Caused by: org.apache.solr.common.cloud.ZooKeeperException: 
	at __randomizedtesting.SeedInfo.seed([C9505F2D83ABFC2B]:0)
	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:234)
Caused by: org.apache.solr.common.SolrException: java.io.FileNotFoundException: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/source_collection_shard1_replica2/data/tlog/tlog.0000000000000000007.1508946704600137728 (No such file or directory)
	at org.apache.solr.update.CdcrTransactionLog.reopenOutputStream(CdcrTransactionLog.java:244)
	at org.apache.solr.update.CdcrTransactionLog.incref(CdcrTransactionLog.java:173)
	at org.apache.solr.update.UpdateLog.getRecentUpdates(UpdateLog.java:1079)
	at org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(UpdateLog.java:1579)
	at org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(UpdateLog.java:1610)
	at org.apache.solr.core.SolrCore.seedVersionBuckets(SolrCore.java:877)
	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:526)
	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227)
Caused by: java.io.FileNotFoundException: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/source_collection_shard1_replica2/data/tlog/tlog.0000000000000000007.1508946704600137728 (No such file or directory)
	at java.io.RandomAccessFile.open0(Native Method)
	at java.io.RandomAccessFile.open(RandomAccessFile.java:316)
	at java.io.RandomAccessFile.<init>(RandomAccessFile.java:243)
	at org.apache.solr.update.CdcrTransactionLog.reopenOutputStream(CdcrTransactionLog.java:236)
	... 7 more




Build Log:
[...truncated 10425 lines...]
   [junit4] Suite: org.apache.solr.cloud.CdcrReplicationHandlerTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/init-core-data-001
   [junit4]   2> 375146 INFO  (SUITE-CdcrReplicationHandlerTest-seed#[C9505F2D83ABFC2B]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 375146 INFO  (SUITE-CdcrReplicationHandlerTest-seed#[C9505F2D83ABFC2B]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /lw/i
   [junit4]   2> 375148 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 375148 INFO  (Thread-1191) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 375148 INFO  (Thread-1191) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 375248 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.ZkTestServer start zk server on port:57581
   [junit4]   2> 375248 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 375249 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 375250 INFO  (zkCallback-421-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1e92fb5 name:ZooKeeperConnection Watcher:127.0.0.1:57581 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 375250 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 375251 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 375251 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 375252 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 375252 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 375253 INFO  (zkCallback-422-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@12453954 name:ZooKeeperConnection Watcher:127.0.0.1:57581/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 375253 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 375253 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 375253 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 375254 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 375254 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 375254 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 375255 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-cdcr.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 375255 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 375256 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
   [junit4]   2> 375256 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 375257 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 375257 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 375257 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 375258 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 375258 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 375258 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 375259 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 375259 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 375259 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 375259 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 375260 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 375260 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 375261 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 375261 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 375261 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 375261 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 375262 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 375262 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 375263 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 375263 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 375264 INFO  (zkCallback-423-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@750df039 name:ZooKeeperConnection Watcher:127.0.0.1:57581/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 375264 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 375264 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 375264 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.SolrTestCaseJ4 ###Starting doTest
   [junit4]   2> 375315 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1
   [junit4]   2> 375316 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 375317 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@26154a86{/lw/i,null,AVAILABLE}
   [junit4]   2> 375323 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.e.j.s.ServerConnector Started ServerConnector@5e28212e{SSL-http/1.1}{127.0.0.1:53508}
   [junit4]   2> 375323 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.e.j.s.Server Started @377293ms
   [junit4]   2> 375323 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard1, hostContext=/lw/i, hostPort=53508, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores}
   [junit4]   2> 375323 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 375323 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/'
   [junit4]   2> 375333 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 375333 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 375334 INFO  (zkCallback-424-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@11dc02e3 name:ZooKeeperConnection Watcher:127.0.0.1:57581/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 375334 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 375334 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 375335 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 375335 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/solr.xml
   [junit4]   2> 375338 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores
   [junit4]   2> 375338 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.CoreContainer New CoreContainer 1542174862
   [junit4]   2> 375338 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/]
   [junit4]   2> 375338 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/lib
   [junit4]   2> 375339 WARN  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/lib).
   [junit4]   2> 375343 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 375345 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 375346 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 375346 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 375346 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57581/solr
   [junit4]   2> 375346 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 375346 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 375346 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 375347 INFO  (zkCallback-426-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1bb395ac name:ZooKeeperConnection Watcher:127.0.0.1:57581 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 375348 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 375348 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 375349 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 375349 INFO  (zkCallback-427-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4a990137 name:ZooKeeperConnection Watcher:127.0.0.1:57581/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 375349 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 375350 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 375351 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 375351 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 375352 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 375353 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 375354 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 375354 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 375355 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 375355 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 375355 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:53508_lw%2Fi
   [junit4]   2> 375356 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:53508_lw%2Fi
   [junit4]   2> 375356 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 375356 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 375357 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 375357 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000
   [junit4]   2> 375357 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:53508_lw%2Fi
   [junit4]   2> 375357 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 375358 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.Overseer Overseer (id=94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) starting
   [junit4]   2> 375359 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 375360 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=30000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 375361 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 375361 INFO  (OverseerCollectionProcessor-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.OverseerProcessor Process current queue of overseer operations
   [junit4]   2> 375361 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 375371 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 375371 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 375372 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.CoresLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores
   [junit4]   2> 375372 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1, collection=tmp_collection, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 375373 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.CoresLocator Found core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1/
   [junit4]   2> 375373 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 375373 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.s.SolrDispatchFilter user.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 375373 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 375373 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 375373 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 375374 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 375374 INFO  (zkCallback-427-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 375374 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:53508/lw/i",
   [junit4]   2>   "node_name":"127.0.0.1:53508_lw%2Fi",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 375375 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:53508/lw/i",
   [junit4]   2>   "node_name":"127.0.0.1:53508_lw%2Fi",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 375375 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.o.ClusterStateMutator building a new cName: tmp_collection
   [junit4]   2> 375375 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 375375 INFO  (zkCallback-427-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 376374 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 376374 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:tmp_collection
   [junit4]   2> 376375 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController Creating collection in ZooKeeper:tmp_collection
   [junit4]   2> 376375 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController Looking for collection configName
   [junit4]   2> 376375 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController Only one config set found in zk - using it:conf1
   [junit4]   2> 376375 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection
   [junit4]   2> 376376 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
   [junit4]   2> 376376 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 376376 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1/'
   [junit4]   2> 376384 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 376387 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 376388 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 376392 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 376392 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 376395 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 376446 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 376447 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 376447 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 376449 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 376457 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 376457 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
   [junit4]   2> 376457 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
   [junit4]   2> 376461 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 376461 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@350560c5
   [junit4]   2> 376461 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1/data
   [junit4]   2> 376461 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1/data/index/
   [junit4]   2> 376462 WARN  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 376462 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1/data/index
   [junit4]   2> 376462 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1513773527, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 376527 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 376527 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 376527 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1/data/
   [junit4]   2> 376530 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "cdcr-processor-chain"
   [junit4]   2> 376538 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 376539 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 376540 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 376540 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 376541 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 376547 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/cdcr,/update,/admin/file
   [junit4]   2> 376547 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 376557 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 376557 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 376558 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 376558 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 376558 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 376559 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-001/cores/collection1/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 376559 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 376559 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@2928a157[collection1] main
   [junit4]   2> 376559 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
   [junit4]   2> 376559 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 376560 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 376560 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 376560 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 376560 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 376560 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 376560 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 376560 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 376560 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 376563 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/cdcr/state
   [junit4]   2> 376564 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.CdcrBufferStateManager Created znode /collections/tmp_collection/cdcr/state/buffer
   [junit4]   2> 376566 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.CdcrProcessStateManager Created znode /collections/tmp_collection/cdcr/state/process
   [junit4]   2> 376576 INFO  (searcherExecutor-1182-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2928a157[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 376576 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 376576 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 376577 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 376577 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1508946675160317952
   [junit4]   2> 376578 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 2.0ms to seed version buckets with highest version 1508946675160317952
   [junit4]   2> 376578 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 376579 INFO  (coreLoadExecutor-1181-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 376579 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:53508/lw/i collection:tmp_collection shard:shard1
   [junit4]   2> 376579 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/leader_elect/shard1/election
   [junit4]   2> 376581 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/tmp_collection/leader_elect/shard1/election/94309167103934469-core_node1-n_0000000000
   [junit4]   2> 376581 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 376582 INFO  (zkCallback-427-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 376582 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 376582 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 376582 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"tmp_collection"} current state version: 1
   [junit4]   2> 376582 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:53508/lw/i/collection1/
   [junit4]   2> 376582 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 376583 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:53508/lw/i/collection1/ has no replicas
   [junit4]   2> 376583 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:53508/lw/i/collection1/ shard1
   [junit4]   2> 376583 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/tmp_collection/leaders/shard1
   [junit4]   2> 376584 INFO  (zkCallback-427-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.h.CdcrProcessStateManager Received new leader state @ tmp_collection:shard1
   [junit4]   2> 376584 INFO  (zkCallback-427-thread-2-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 376585 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "base_url":"https://127.0.0.1:53508/lw/i",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 376686 INFO  (zkCallback-427-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 376735 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:53508/lw/i/collection1/ and leader is https://127.0.0.1:53508/lw/i/collection1/
   [junit4]   2> 376735 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:53508/lw/i
   [junit4]   2> 376735 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 376736 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 376736 INFO  (coreZkRegister-1175-thread-1-processing-n:127.0.0.1:53508_lw%2Fi x:collection1 s:shard1 c:tmp_collection r:core_node1) [n:127.0.0.1:53508_lw%2Fi c:tmp_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 376736 INFO  (zkCallback-427-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 376737 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:53508/lw/i",
   [junit4]   2>   "node_name":"127.0.0.1:53508_lw%2Fi",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 376737 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:53508/lw/i",
   [junit4]   2>   "node_name":"127.0.0.1:53508_lw%2Fi",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 376838 INFO  (zkCallback-427-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 376955 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1
   [junit4]   2> 376957 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 376958 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@137d7ecb{/lw/i,null,AVAILABLE}
   [junit4]   2> 376962 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.e.j.s.ServerConnector Started ServerConnector@39efa2f7{SSL-http/1.1}{127.0.0.1:43857}
   [junit4]   2> 376962 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.e.j.s.Server Started @378933ms
   [junit4]   2> 376962 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {shards=shard2, hostContext=/lw/i, hostPort=43857, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores}
   [junit4]   2> 376963 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 376963 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/'
   [junit4]   2> 376988 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 376989 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 376989 INFO  (zkCallback-428-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@519d4411 name:ZooKeeperConnection Watcher:127.0.0.1:57581/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 376990 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 376990 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 376991 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 376991 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/solr.xml
   [junit4]   2> 376995 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores
   [junit4]   2> 376995 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.CoreContainer New CoreContainer 1511706000
   [junit4]   2> 376995 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/]
   [junit4]   2> 376995 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/lib
   [junit4]   2> 376996 WARN  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/lib).
   [junit4]   2> 377002 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 377004 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 377006 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 377006 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 377006 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:57581/solr
   [junit4]   2> 377006 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 377006 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 377007 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 377007 INFO  (zkCallback-430-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1c55dbb1 name:ZooKeeperConnection Watcher:127.0.0.1:57581 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 377008 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 377009 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 377009 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 377010 INFO  (zkCallback-431-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3fd3eee8 name:ZooKeeperConnection Watcher:127.0.0.1:57581/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 377010 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 377012 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 378013 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43857_lw%2Fi
   [junit4]   2> 378014 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:43857_lw%2Fi
   [junit4]   2> 378015 INFO  (zkCallback-427-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 378015 INFO  (zkCallback-431-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 378015 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 378015 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94309167103934472-127.0.0.1:43857_lw%2Fi-n_0000000001
   [junit4]   2> 378016 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000 to know if I could be the leader
   [junit4]   2> 378032 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 378033 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 378033 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.CoresLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores
   [junit4]   2> 378034 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1, collection=tmp_collection, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 378034 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.CoresLocator Found core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1/
   [junit4]   2> 378034 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 378035 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.s.SolrDispatchFilter user.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 378035 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 378035 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 378035 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 378035 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController Registering watch for collection tmp_collection
   [junit4]   2> 378036 INFO  (zkCallback-427-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 378036 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch tmp_collection
   [junit4]   2> 378036 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader Deleting data for tmp_collection
   [junit4]   2> 378036 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:43857/lw/i",
   [junit4]   2>   "node_name":"127.0.0.1:43857_lw%2Fi",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"} current state version: 3
   [junit4]   2> 378036 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 378036 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:43857/lw/i",
   [junit4]   2>   "node_name":"127.0.0.1:43857_lw%2Fi",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"tmp_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 378036 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=1
   [junit4]   2> 378037 INFO  (OverseerStateUpdate-94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 378138 INFO  (zkCallback-427-thread-1-processing-n:127.0.0.1:53508_lw%2Fi) [n:127.0.0.1:53508_lw%2Fi    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 378138 INFO  (zkCallback-431-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 2)
   [junit4]   2> 379036 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 379036 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:tmp_collection
   [junit4]   2> 379037 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 379037 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
   [junit4]   2> 379037 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 379037 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1/'
   [junit4]   2> 379045 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 379047 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 379049 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 379053 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 379054 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 379057 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 379113 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 379113 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 379114 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 379115 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 379122 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0
   [junit4]   2> 379122 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection tmp_collection
   [junit4]   2> 379122 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore solr.StandardDirectoryFactory
   [junit4]   2> 379122 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1/], dataDir=[null]
   [junit4]   2> 379122 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@350560c5
   [junit4]   2> 379123 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1/data
   [junit4]   2> 379123 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1/data/index/
   [junit4]   2> 379123 WARN  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 379123 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1/data/index
   [junit4]   2> 379124 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1513773527, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 379192 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 379192 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 379192 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1/data/
   [junit4]   2> 379195 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "cdcr-processor-chain"
   [junit4]   2> 379195 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 379197 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 379197 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 379198 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 379198 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 379202 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/cdcr,/update,/admin/file
   [junit4]   2> 379202 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 379202 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 379202 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 379203 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 379203 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 379204 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=38, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 379204 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/collection1/data/index,segFN=segments_1,generation=1}
   [junit4]   2> 379204 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 379205 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@15a76876[collection1] main
   [junit4]   2> 379205 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/tmp_collection
   [junit4]   2> 379205 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/tmp_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 379205 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 379206 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 379206 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 379206 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 379206 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 379206 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 379206 INFO  (coreLoadExecutor-1193-thread-1-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi c:tmp_collection s:shard1 r:core_node2 x:collection1] o.a.s

[...truncated too long message...]

t4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getClusterProps(ZkStateReader.java:725)
   [junit4]   2> 	... 3 more
   [junit4]   2> 
   [junit4]   2> 803641 INFO  (zkCallback-531-thread-3-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 803642 WARN  (zkCallback-531-thread-3-processing-n:127.0.0.1:43857_lw%2Fi) [n:127.0.0.1:43857_lw%2Fi    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK
   [junit4]   2> 803643 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@727b04ef{SSL-http/1.1}{127.0.0.1:43857}
   [junit4]   2> 803643 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@8fabfb5{/lw/i,null,UNAVAILABLE}
   [junit4]   2> 803644 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi c:source_collection s:shard1 r:core_node1 x:source_collection_shard1_replica1] o.a.s.SolrTestCaseJ4 ###Ending doTest
   [junit4]   2> 803645 INFO  (TEST-CdcrReplicationHandlerTest.doTest-seed#[C9505F2D83ABFC2B]) [n:127.0.0.1:53508_lw%2Fi c:source_collection s:shard1 r:core_node1 x:source_collection_shard1_replica1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57581 57581
   [junit4]   2> 803718 INFO  (Thread-1191) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:57581 57581
   [junit4]   2> 803719 WARN  (Thread-1191) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	43	/solr/aliases.json
   [junit4]   2> 	8	/solr/configs/conf1
   [junit4]   2> 	5	/solr/collections/source_collection/leaders/shard1
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	2	/solr/collections/tmp_collection/leaders/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	43	/solr/clusterstate.json
   [junit4]   2> 	7	/solr/collections/source_collection/cdcr/state/buffer
   [junit4]   2> 	7	/solr/collections/source_collection/cdcr/state/process
   [junit4]   2> 	4	/solr/collections/source_collection/state.json
   [junit4]   2> 	3	/solr/overseer_elect/election/94309167103934469-127.0.0.1:53508_lw%2Fi-n_0000000000
   [junit4]   2> 	3	/solr/collections/source_collection/leader_elect/shard1/election/94309167103934469-core_node2-n_0000000000
   [junit4]   2> 	2	/solr/collections/tmp_collection/cdcr/state/buffer
   [junit4]   2> 	2	/solr/collections/tmp_collection/cdcr/state/process
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	41	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CdcrReplicationHandlerTest -Dtests.method=doTest -Dtests.seed=C9505F2D83ABFC2B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es_BO -Dtests.timezone=America/Kentucky/Monticello -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR    429s J0 | CdcrReplicationHandlerTest.doTest <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: There are still nodes recoverying - waited for 330 seconds
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:172)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:133)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:128)
   [junit4]    > 	at org.apache.solr.cloud.BaseCdcrDistributedZkTest.waitForRecoveriesToFinish(BaseCdcrDistributedZkTest.java:465)
   [junit4]    > 	at org.apache.solr.cloud.BaseCdcrDistributedZkTest.restartServer(BaseCdcrDistributedZkTest.java:506)
   [junit4]    > 	at org.apache.solr.cloud.CdcrReplicationHandlerTest.doTestPartialReplication(CdcrReplicationHandlerTest.java:109)
   [junit4]    > 	at org.apache.solr.cloud.CdcrReplicationHandlerTest.doTest(CdcrReplicationHandlerTest.java:51)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=3409, name=RecoveryThread-source_collection_shard1_replica2, state=RUNNABLE, group=TGRP-CdcrReplicationHandlerTest]
   [junit4]    > Caused by: org.apache.solr.common.cloud.ZooKeeperException: 
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([C9505F2D83ABFC2B]:0)
   [junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:234)
   [junit4]    > Caused by: org.apache.solr.common.SolrException: java.io.FileNotFoundException: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/source_collection_shard1_replica2/data/tlog/tlog.0000000000000000007.1508946704600137728 (No such file or directory)
   [junit4]    > 	at org.apache.solr.update.CdcrTransactionLog.reopenOutputStream(CdcrTransactionLog.java:244)
   [junit4]    > 	at org.apache.solr.update.CdcrTransactionLog.incref(CdcrTransactionLog.java:173)
   [junit4]    > 	at org.apache.solr.update.UpdateLog.getRecentUpdates(UpdateLog.java:1079)
   [junit4]    > 	at org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(UpdateLog.java:1579)
   [junit4]    > 	at org.apache.solr.update.UpdateLog.seedBucketsWithHighestVersion(UpdateLog.java:1610)
   [junit4]    > 	at org.apache.solr.core.SolrCore.seedVersionBuckets(SolrCore.java:877)
   [junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:526)
   [junit4]    > 	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:227)
   [junit4]    > Caused by: java.io.FileNotFoundException: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001/jetty-002/cores/source_collection_shard1_replica2/data/tlog/tlog.0000000000000000007.1508946704600137728 (No such file or directory)
   [junit4]    > 	at java.io.RandomAccessFile.open0(Native Method)
   [junit4]    > 	at java.io.RandomAccessFile.open(RandomAccessFile.java:316)
   [junit4]    > 	at java.io.RandomAccessFile.<init>(RandomAccessFile.java:243)
   [junit4]    > 	at org.apache.solr.update.CdcrTransactionLog.reopenOutputStream(CdcrTransactionLog.java:236)
   [junit4]    > 	... 7 more
   [junit4]   2> 803726 INFO  (SUITE-CdcrReplicationHandlerTest-seed#[C9505F2D83ABFC2B]-worker) [n:127.0.0.1:53508_lw%2Fi c:source_collection s:shard1 r:core_node1 x:source_collection_shard1_replica1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrReplicationHandlerTest_C9505F2D83ABFC2B-001
   [junit4]   2> Aug 08, 2015 2:28:36 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=DefaultSimilarity, locale=es_BO, timezone=America/Kentucky/Monticello
   [junit4]   2> NOTE: Linux 3.16.0-44-generic amd64/Oracle Corporation 1.8.0_60-ea (64-bit)/cpus=12,threads=1,free=136221032,total=508952576
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolr4Spatial, LeaderInitiatedRecoveryOnCommitTest, AliasIntegrationTest, TestJsonRequest, TestPostingsSolrHighlighter, TestScoreJoinQPNoScore, TestFieldResource, BufferStoreTest, ConcurrentDeleteAndCreateCollectionTest, CloudMLTQParserTest, TestAuthenticationFramework, FacetPivotSmallTest, TestSearcherReuse, DataDrivenBlockJoinTest, SaslZkACLProviderTest, UUIDFieldTest, CSVRequestHandlerTest, DeleteReplicaTest, LeaderElectionIntegrationTest, DistributedSpellCheckComponentTest, AsyncCallRequestStatusResponseTest, RankQueryTest, TriLevelCompositeIdRoutingTest, DeleteShardTest, TestRemoteStreaming, TestIntervalFaceting, SuggesterFSTTest, TestMissingGroups, TimeZoneUtilsTest, AddSchemaFieldsUpdateProcessorFactoryTest, TestJoin, CdcrReplicationHandlerTest]
   [junit4] Completed [217/539] on J0 in 428.85s, 1 test, 1 error <<< FAILURES!

[...truncated 1004 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:716: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:660: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:230: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:514: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1429: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:984: There were test failures: 539 suites, 2126 tests, 1 error, 67 ignored (31 assumptions)

Total time: 46 minutes 41 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_51) - Build # 13783 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13783/
Java: 64bit/jdk1.8.0_51 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionStateFormat2Test.test

Error Message:
Error from server at http://127.0.0.1:58742: Could not find collection : myExternColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:58742: Could not find collection : myExternColl
	at __randomizedtesting.SeedInfo.seed([B109928B6145D43B:395DAD51CFB9B9C3]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionStateFormat2Test.testZkNodeLocation(CollectionStateFormat2Test.java:84)
	at org.apache.solr.cloud.CollectionStateFormat2Test.test(CollectionStateFormat2Test.java:40)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10802 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionStateFormat2Test
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/init-core-data-001
   [junit4]   2> 1208561 INFO  (SUITE-CollectionStateFormat2Test-seed#[B109928B6145D43B]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 1208561 INFO  (SUITE-CollectionStateFormat2Test-seed#[B109928B6145D43B]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 1208563 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1208563 INFO  (Thread-3156) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1208563 INFO  (Thread-3156) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1208663 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.ZkTestServer start zk server on port:48512
   [junit4]   2> 1208663 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1208664 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1208666 INFO  (zkCallback-912-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@460e9b50 name:ZooKeeperConnection Watcher:127.0.0.1:48512 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1208666 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1208666 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1208666 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 1208667 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1208668 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1208668 INFO  (zkCallback-913-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@27f6db9d name:ZooKeeperConnection Watcher:127.0.0.1:48512/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1208668 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1208668 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1208669 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 1208669 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 1208670 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 1208670 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 1208670 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 1208671 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 1208671 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 1208671 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 1208672 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1208672 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 1208673 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 1208673 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 1208673 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 1208679 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 1208680 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 1208680 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 1208681 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 1208681 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 1208681 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1208681 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 1208682 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1208682 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 1208683 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 1208683 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 1208683 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 1208683 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 1208732 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1
   [junit4]   2> 1208733 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 1208733 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@621cc975{/,null,AVAILABLE}
   [junit4]   2> 1208734 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.e.j.s.ServerConnector Started ServerConnector@4c59d609{HTTP/1.1}{127.0.0.1:58742}
   [junit4]   2> 1208734 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.e.j.s.Server Started @1210689ms
   [junit4]   2> 1208734 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/tempDir-001/control/data, hostContext=/, hostPort=58742, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores}
   [junit4]   2> 1208735 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1208735 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/'
   [junit4]   2> 1208742 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1208743 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1208743 INFO  (zkCallback-914-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@45b521d3 name:ZooKeeperConnection Watcher:127.0.0.1:48512/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1208743 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1208744 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1208744 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1208744 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/solr.xml
   [junit4]   2> 1208747 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores
   [junit4]   2> 1208747 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.CoreContainer New CoreContainer 1369763149
   [junit4]   2> 1208748 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/]
   [junit4]   2> 1208748 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/lib
   [junit4]   2> 1208748 WARN  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/lib).
   [junit4]   2> 1208752 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1208753 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1208753 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1208753 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1208753 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48512/solr
   [junit4]   2> 1208753 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1208753 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1208754 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1208754 INFO  (zkCallback-916-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@75e9714 name:ZooKeeperConnection Watcher:127.0.0.1:48512 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1208754 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1208755 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1208755 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1208756 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@6e282bc6 name:ZooKeeperConnection Watcher:127.0.0.1:48512/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1208756 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1208756 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 1208757 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 1208757 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 1208758 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 1208759 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 1208759 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 1208760 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 1208760 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 1208760 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 1208761 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:58742_
   [junit4]   2> 1208761 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:58742_
   [junit4]   2> 1208761 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 1208762 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 1208762 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1208762 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94311224725078020-127.0.0.1:58742_-n_0000000000
   [junit4]   2> 1208763 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:58742_
   [junit4]   2> 1208763 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 1208763 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.Overseer Overseer (id=94311224725078020-127.0.0.1:58742_-n_0000000000) starting
   [junit4]   2> 1208764 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 1208766 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 1208766 INFO  (OverseerCollectionProcessor-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.OverseerProcessor Process current queue of overseer operations
   [junit4]   2> 1208766 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1208766 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 1208777 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1208777 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1208777 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores
   [junit4]   2> 1208778 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1208778 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.CoresLocator Found core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1/
   [junit4]   2> 1208778 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1208779 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1208779 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.s.SolrDispatchFilter user.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1208779 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:58742_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1208779 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1208779 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1208779 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1208780 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:58742",
   [junit4]   2>   "node_name":"127.0.0.1:58742_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 1208780 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:58742",
   [junit4]   2>   "node_name":"127.0.0.1:58742_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1208780 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 1208780 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 1208780 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1209779 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1209780 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 1209780 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1209780 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1209780 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1209780 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1/'
   [junit4]   2> 1209786 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1209788 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1209791 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1209797 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1209798 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1209800 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1209864 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1209868 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1209868 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1209871 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1209873 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1209873 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1209874 WARN  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1209874 WARN  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1209874 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1209874 WARN  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1209874 WARN  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1209875 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1209875 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 1209875 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 1209875 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 1209875 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@9b585d6
   [junit4]   2> 1209875 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1/data
   [junit4]   2> 1209876 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1/data/index/
   [junit4]   2> 1209876 WARN  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 1209876 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1/data/index
   [junit4]   2> 1209876 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.MockRandomMergePolicy: org.apache.lucene.index.MockRandomMergePolicy@74b91231
   [junit4]   2> 1209877 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@5ce2bcfe lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@10eaf5fe),segFN=segments_1,generation=1}
   [junit4]   2> 1209877 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1209877 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1/data/
   [junit4]   2> 1209877 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 1209878 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 1209878 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 1209879 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 1209879 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1209879 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 1209879 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 1209879 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1209879 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 1209879 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 1209880 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1209880 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1209881 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1209881 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 1209883 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 1209883 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 1209883 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1209884 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1209884 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 1209884 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 1209884 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=212587363, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 1209885 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@5ce2bcfe lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@10eaf5fe),segFN=segments_1,generation=1}
   [junit4]   2> 1209885 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 1209885 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@497ff079[collection1] main
   [junit4]   2> 1209885 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 1209885 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1209886 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 1209886 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 1209886 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 1209886 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1209886 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 1209886 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 1209886 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 1209886 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1209887 INFO  (searcherExecutor-3426-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@497ff079[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1209887 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 1209887 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 1209887 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 1209887 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1508979596988514304
   [junit4]   2> 1209889 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1508979596988514304
   [junit4]   2> 1209889 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 1209889 INFO  (coreLoadExecutor-3425-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 1209889 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:58742 collection:control_collection shard:shard1
   [junit4]   2> 1209890 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 1209891 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94311224725078020-core_node1-n_0000000000
   [junit4]   2> 1209891 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 1209891 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1209891 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1209891 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1209892 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 1209892 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:58742/collection1/
   [junit4]   2> 1209892 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1209892 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:58742/collection1/ has no replicas
   [junit4]   2> 1209892 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:58742/collection1/ shard1
   [junit4]   2> 1209892 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 1209893 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1209893 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:58742",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 1209994 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1210043 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:58742/collection1/ and leader is http://127.0.0.1:58742/collection1/
   [junit4]   2> 1210043 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:58742
   [junit4]   2> 1210043 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1210043 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 1210044 INFO  (coreZkRegister-3419-thread-1-processing-n:127.0.0.1:58742_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:58742_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1210044 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1210045 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:58742",
   [junit4]   2>   "node_name":"127.0.0.1:58742_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 1210045 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:58742",
   [junit4]   2>   "node_name":"127.0.0.1:58742_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1210146 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1210280 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1210280 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1210281 INFO  (zkCallback-919-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@54831f87 name:ZooKeeperConnection Watcher:127.0.0.1:48512/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1210281 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1210281 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1210282 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1210282 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 1210282 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 1210282 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1210283 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1210283 INFO  (zkCallback-920-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@44ad04aa name:ZooKeeperConnection Watcher:127.0.0.1:48512/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1210283 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1210283 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1210284 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1210284 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 1210284 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 1210341 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/cores/collection1
   [junit4]   2> 1210341 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001
   [junit4]   2> 1210342 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 1210342 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@81f1b54{/,null,AVAILABLE}
   [junit4]   2> 1210342 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.e.j.s.ServerConnector Started ServerConnector@2eba1196{HTTP/1.1}{127.0.0.1:47610}
   [junit4]   2> 1210343 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.e.j.s.Server Started @1212297ms
   [junit4]   2> 1210343 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=47610, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/cores}
   [junit4]   2> 1210343 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 1210343 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/'
   [junit4]   2> 1210351 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1210351 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1210352 INFO  (zkCallback-921-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@607c8d14 name:ZooKeeperConnection Watcher:127.0.0.1:48512/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1210352 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1210352 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1210352 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 1210352 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/solr.xml
   [junit4]   2> 1210355 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/cores
   [junit4]   2> 1210355 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.CoreContainer New CoreContainer 1884082169
   [junit4]   2> 1210355 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/]
   [junit4]   2> 1210355 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/lib
   [junit4]   2> 1210355 WARN  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/lib).
   [junit4]   2> 1210359 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 1210360 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 1210360 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 1210360 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 1210361 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:48512/solr
   [junit4]   2> 1210361 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 1210361 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 1210361 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1210362 INFO  (zkCallback-923-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c239cf5 name:ZooKeeperConnection Watcher:127.0.0.1:48512 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1210362 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1210362 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 1210363 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 1210363 INFO  (zkCallback-924-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@64498dce name:ZooKeeperConnection Watcher:127.0.0.1:48512/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 1210363 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 1210365 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 1210385 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 1210386 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1210386 INFO  (zkCallback-919-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1210386 INFO  (zkCallback-924-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1211366 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:47610_
   [junit4]   2> 1211367 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:47610_
   [junit4]   2> 1211367 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1211367 INFO  (zkCallback-924-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1211367 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1211367 INFO  (zkCallback-919-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 1211368 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94311224725078025-127.0.0.1:47610_-n_0000000001
   [junit4]   2> 1211368 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94311224725078020-127.0.0.1:58742_-n_0000000000 to know if I could be the leader
   [junit4]   2> 1211375 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 1211375 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 1211375 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/cores
   [junit4]   2> 1211376 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 1211376 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.CoresLocator Found core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/cores/collection1/
   [junit4]   2> 1211376 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 1211376 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.s.SolrDispatchFilter user.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1211377 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:47610_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 1211377 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 1211377 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 1211377 INFO  (zkCallback-917-thread-1-processing-n:127.0.0.1:58742_) [n:127.0.0.1:58742_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 1211377 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 1211377 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
   [junit4]   2> 1211377 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:47610",
   [junit4]   2>   "node_name":"127.0.0.1:47610_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 4
   [junit4]   2> 1211377 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 0 
   [junit4]   2> 1211378 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 1211378 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:47610",
   [junit4]   2>   "node_name":"127.0.0.1:47610_",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 1211378 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
   [junit4]   2> 1211378 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 1211479 INFO  (OverseerStateUpdate-94311224725078020-127.0.0.1:58742_-n_0000000000) [n:127.0.0.1:58742_    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 1211479 INFO  (zkCallback-924-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
   [junit4]   2> 1211479 INFO  (zkCallback-924-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_    ] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 1 
   [junit4]   2> 1212378 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 1212378 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.ZkController Check for collection zkNode:collection1
   [junit4]   2> 1212378 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 1212378 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/collection1
   [junit4]   2> 1212379 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/collection1 configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 1212379 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001/shard-1-001/cores/collection1/'
   [junit4]   2> 1212385 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 1212387 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 1212390 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 1212395 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 1212396 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 1212398 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 1212456 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 1212459 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 1212460 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 1212463 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1212464 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 1212465 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1212465 WARN  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1212465 WARN  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1212465 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 1212465 WARN  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 1212466 WARN  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 1212466 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 1212466 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 1212466 INFO  (coreLoadExecutor-3436-thread-1-processing-n:127.0.0.1:47610_) [n:127.0.0.1:47610_ c:collection1 s:shard2 r:core_node1 x:col

[...truncated too long message...]

 [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:493)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:463)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:450)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:141)
   [junit4]   2> 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:137)
   [junit4]   2> 	... 12 more
   [junit4]   2> 
   [junit4]   2> 1263778 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@6955d024{HTTP/1.1}{127.0.0.1:0}
   [junit4]   2> 1263778 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@2af92801{/,null,UNAVAILABLE}
   [junit4]   2> 1263779 INFO  (TEST-CollectionStateFormat2Test.test-seed#[B109928B6145D43B]) [n:127.0.0.1:46344_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48512 48512
   [junit4]   2> 1263811 INFO  (Thread-3156) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:48512 48512
   [junit4]   2> 1263811 WARN  (Thread-3156) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/collections/collection1/state.json
   [junit4]   2> 	4	/solr/collections/myExternColl/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/live_nodes
   [junit4]   2> 	4	/solr/overseer/queue
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionStateFormat2Test -Dtests.method=test -Dtests.seed=B109928B6145D43B -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=fr_CH -Dtests.timezone=Pacific/Kiritimati -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   55.3s J1 | CollectionStateFormat2Test.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:58742: Could not find collection : myExternColl
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([B109928B6145D43B:395DAD51CFB9B9C3]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    > 	at org.apache.solr.cloud.CollectionStateFormat2Test.testZkNodeLocation(CollectionStateFormat2Test.java:84)
   [junit4]    > 	at org.apache.solr.cloud.CollectionStateFormat2Test.test(CollectionStateFormat2Test.java:40)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 1263819 INFO  (SUITE-CollectionStateFormat2Test-seed#[B109928B6145D43B]-worker) [n:127.0.0.1:46344_ c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_B109928B6145D43B-001
   [junit4]   2> Aug 08, 2015 11:05:39 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=14343, maxDocsPerChunk=567, blockSize=246), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=14343, blockSize=246)), sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {}, locale=fr_CH, timezone=Pacific/Kiritimati
   [junit4]   2> NOTE: Linux 3.16.0-44-generic amd64/Oracle Corporation 1.8.0_51 (64-bit)/cpus=12,threads=1,free=196174008,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [DistributedFacetPivotLargeTest, ChaosMonkeySafeLeaderTest, TestCustomDocTransformer, SpatialRPTFieldTypeTest, TestCopyFieldCollectionResource, StatelessScriptUpdateProcessorFactoryTest, TestPHPSerializedResponseWriter, TestValueSourceCache, TestElisionMultitermQuery, SystemInfoHandlerTest, RollingRestartTest, OpenCloseCoreStressTest, TestSolrQueryParserDefaultOperatorResource, RAMDirectoryFactoryTest, HttpPartitionTest, SolrCmdDistributorTest, TestJettySolrRunner, TestCrossCoreJoin, TestMiniSolrCloudClusterSSL, CopyFieldTest, TestDistribDocBasedVersion, TestCloudManagedSchema, ShardRoutingTest, PKIAuthenticationIntegrationTest, QueryResultKeyTest, TestSolrCoreProperties, ActionThrottleTest, TestSuggestSpellingConverter, TestFuzzyAnalyzedSuggestions, TestSearchPerf, TestSortingResponseWriter, SpatialFilterTest, TestSolrDeletionPolicy2, BadCopyFieldTest, CollectionsAPIDistributedZkTest, DistributedFacetPivotWhiteBoxTest, TestRTGBase, TestObjectReleaseTracker, TestRecoveryHdfs, TestComponentsName, DocumentAnalysisRequestHandlerTest, TestFiltering, CurrencyFieldOpenExchangeTest, InfoHandlerTest, TestAtomicUpdateErrorCases, CollectionTooManyReplicasTest, IndexSchemaRuntimeFieldTest, TestLMDirichletSimilarityFactory, TestSolr4Spatial2, TestRemoveLastDynamicCopyField, CoreAdminHandlerTest, UpdateParamsTest, TestLRUCache, FieldAnalysisRequestHandlerTest, ZkCLITest, TestLFUCache, TestCharFilters, TestAnalyzedSuggestions, HdfsLockFactoryTest, TestSchemaSimilarityResource, AsyncMigrateRouteKeyTest, TestEmbeddedSolrServerConstructors, TestChildDocTransformer, DistributedIntervalFacetingTest, NoCacheHeaderTest, TestManagedSynonymFilterFactory, DocValuesMultiTest, CleanupOldIndexTest, DistributedMLTComponentTest, TestSchemaVersionResource, TestIndexSearcher, ResourceLoaderTest, AlternateDirectoryTest, HdfsRecoveryZkTest, DocExpirationUpdateProcessorFactoryTest, TestFastWriter, VMParamsZkACLAndCredentialsProvidersTest, ZkSolrClientTest, AnalysisErrorHandlingTest, BasicFunctionalityTest, DistributedQueryComponentOptimizationTest, TestBlendedInfixSuggestions, SolrPluginUtilsTest, SolrCloudExampleTest, WordBreakSolrSpellCheckerTest, MultiThreadedOCPTest, BasicDistributedZk2Test, RecoveryZkTest, FullSolrCloudDistribCmdsTest, TestDistributedSearch, TestTolerantSearch, AliasIntegrationTest, CollectionStateFormat2Test]
   [junit4] Completed [406/539] on J1 in 55.78s, 1 test, 1 error <<< FAILURES!

[...truncated 419 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:716: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:660: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:230: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:514: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1429: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:984: There were test failures: 539 suites, 2126 tests, 1 error, 67 ignored (31 assumptions)

Total time: 47 minutes 56 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_51) - Build # 13782 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13782/
Java: 64bit/jdk1.8.0_51 -XX:+UseCompressedOops -XX:+UseG1GC

3 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
5 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest:     1) Thread[id=6699, name=zkCallback-1312-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    2) Thread[id=6697, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]-SendThread(127.0.0.1:53253), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)    3) Thread[id=6747, name=zkCallback-1312-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    4) Thread[id=6758, name=zkCallback-1312-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    5) Thread[id=6698, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 5 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
   1) Thread[id=6699, name=zkCallback-1312-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=6697, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]-SendThread(127.0.0.1:53253), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   3) Thread[id=6747, name=zkCallback-1312-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   4) Thread[id=6758, name=zkCallback-1312-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   5) Thread[id=6698, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
	at __randomizedtesting.SeedInfo.seed([D59D8B8473EC8B00]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.CollectionsAPIDistributedZkTest

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=6699, name=zkCallback-1312-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    2) Thread[id=6697, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]-SendThread(127.0.0.1:53253), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)    3) Thread[id=6747, name=zkCallback-1312-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)    4) Thread[id=6758, name=zkCallback-1312-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)         at java.lang.Thread.run(Thread.java:745)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=6699, name=zkCallback-1312-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   2) Thread[id=6697, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]-SendThread(127.0.0.1:53253), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   3) Thread[id=6747, name=zkCallback-1312-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
   4) Thread[id=6758, name=zkCallback-1312-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
        at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
        at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
        at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
	at __randomizedtesting.SeedInfo.seed([D59D8B8473EC8B00]:0)


FAILED:  org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test

Error Message:
Error from server at http://127.0.0.1:33236: Could not fully remove collection: awholynewcollection_0

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:33236: Could not fully remove collection: awholynewcollection_0
	at __randomizedtesting.SeedInfo.seed([D59D8B8473EC8B00:5DC9B45EDD10E6F8]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.makeRequest(CollectionsAPIDistributedZkTest.java:302)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCollectionsAPI(CollectionsAPIDistributedZkTest.java:762)
	at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.test(CollectionsAPIDistributedZkTest.java:167)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 10304 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/init-core-data-001
   [junit4]   2> 656660 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[D59D8B8473EC8B00]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false)
   [junit4]   2> 656660 INFO  (SUITE-CollectionsAPIDistributedZkTest-seed#[D59D8B8473EC8B00]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 656662 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 656662 INFO  (Thread-2200) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 656662 INFO  (Thread-2200) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 656762 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.ZkTestServer start zk server on port:53253
   [junit4]   2> 656762 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 656763 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 656765 INFO  (zkCallback-1280-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@55a6346f name:ZooKeeperConnection Watcher:127.0.0.1:53253 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 656765 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 656765 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 656765 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 656766 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 656767 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 656767 INFO  (zkCallback-1281-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2e5db068 name:ZooKeeperConnection Watcher:127.0.0.1:53253/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 656768 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 656768 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 656768 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 656769 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 656769 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 656770 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 656770 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 656770 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 656771 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 656771 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 656772 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 656772 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 656773 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 656773 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 656774 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 656774 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 656775 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 656775 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 656775 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 656775 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 656776 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 656776 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 656777 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 656777 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 656777 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 656777 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 656778 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 656778 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 656825 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1
   [junit4]   2> 656826 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 656827 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@11dcb86b{/,null,AVAILABLE}
   [junit4]   2> 656827 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.e.j.s.ServerConnector Started ServerConnector@57713679{HTTP/1.1}{127.0.0.1:43168}
   [junit4]   2> 656827 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.e.j.s.Server Started @658578ms
   [junit4]   2> 656827 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/tempDir-001/control/data, hostContext=/, hostPort=43168, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores}
   [junit4]   2> 656827 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 656827 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/'
   [junit4]   2> 656835 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 656836 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 656837 INFO  (zkCallback-1282-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@46526d38 name:ZooKeeperConnection Watcher:127.0.0.1:53253/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 656837 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 656837 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 656837 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 656837 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/solr.xml
   [junit4]   2> 656840 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores
   [junit4]   2> 656840 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.CoreContainer New CoreContainer 261488800
   [junit4]   2> 656840 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/]
   [junit4]   2> 656840 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/lib
   [junit4]   2> 656841 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/lib).
   [junit4]   2> 656844 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 656845 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 656845 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 656846 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 656846 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53253/solr
   [junit4]   2> 656846 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 656846 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 656846 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 656847 INFO  (zkCallback-1284-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@3c1134fb name:ZooKeeperConnection Watcher:127.0.0.1:53253 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 656847 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 656847 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 656848 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 656849 INFO  (zkCallback-1285-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1b357550 name:ZooKeeperConnection Watcher:127.0.0.1:53253/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 656849 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 656850 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 656850 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 656851 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 656851 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 656852 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 656853 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 656853 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 656854 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 656854 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 656855 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43168_
   [junit4]   2> 656855 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:43168_
   [junit4]   2> 656855 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 656856 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 656857 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 656857 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94310561898364932-127.0.0.1:43168_-n_0000000000
   [junit4]   2> 656857 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:43168_
   [junit4]   2> 656857 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 656858 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.Overseer Overseer (id=94310561898364932-127.0.0.1:43168_-n_0000000000) starting
   [junit4]   2> 656858 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 656860 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 656860 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 656860 INFO  (OverseerCollectionProcessor-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.OverseerProcessor Process current queue of overseer operations
   [junit4]   2> 656860 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 656870 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 656870 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 656870 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.CoresLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores
   [junit4]   2> 656871 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 656871 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.CoresLocator Found core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1/
   [junit4]   2> 656871 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 656871 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 656871 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.s.SolrDispatchFilter user.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 656872 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:43168_    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 656871 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 656872 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 656872 INFO  (zkCallback-1285-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 656872 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43168",
   [junit4]   2>   "node_name":"127.0.0.1:43168_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 656873 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43168",
   [junit4]   2>   "node_name":"127.0.0.1:43168_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 656873 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 656873 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 656873 INFO  (zkCallback-1285-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 657872 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 657872 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 657873 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 657873 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 657873 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 657873 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1/'
   [junit4]   2> 657881 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 657883 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 657886 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 657950 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 657951 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 657954 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 658005 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 658008 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 658009 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 658012 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 658014 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 658015 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 658016 WARN  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 658016 WARN  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 658016 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 658016 WARN  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 658016 WARN  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 658017 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 658017 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 658017 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 658017 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 658017 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@32689cf5
   [junit4]   2> 658018 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1/data
   [junit4]   2> 658018 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1/data/index/
   [junit4]   2> 658018 WARN  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 658018 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1/data/index
   [junit4]   2> 658018 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=16, maxMergedSegmentMB=83.0712890625, floorSegmentMB=1.716796875, forceMergeDeletesPctAllowed=22.22164292883133, segmentsPerTier=33.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.8969995088155828
   [junit4]   2> 658019 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@3f9e525b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@72b6d126),segFN=segments_1,generation=1}
   [junit4]   2> 658019 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 658019 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1/data/
   [junit4]   2> 658019 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 658021 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 658021 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 658021 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 658021 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 658021 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 658021 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 658021 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 658021 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 658021 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 658022 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 658023 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 658024 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 658024 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 658026 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 658026 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 658026 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 658026 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 658027 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 658027 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 658027 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=20, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 658028 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@3f9e525b lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@72b6d126),segFN=segments_1,generation=1}
   [junit4]   2> 658028 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 658028 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@56dafd24[collection1] main
   [junit4]   2> 658028 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 658028 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 658028 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 658029 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 658029 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 658029 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 658029 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 658029 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 658029 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 658029 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 658030 INFO  (searcherExecutor-2586-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@56dafd24[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 658030 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 658030 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 658030 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 658030 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1508968991807242240
   [junit4]   2> 658032 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1508968991807242240
   [junit4]   2> 658032 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 658032 INFO  (coreLoadExecutor-2585-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 658033 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:http://127.0.0.1:43168 collection:control_collection shard:shard1
   [junit4]   2> 658033 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 658034 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94310561898364932-core_node1-n_0000000000
   [junit4]   2> 658034 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 658035 INFO  (zkCallback-1285-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 658035 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 658035 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 658035 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:43168/collection1/
   [junit4]   2> 658035 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 658035 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 658035 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:43168/collection1/ has no replicas
   [junit4]   2> 658036 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:43168/collection1/ shard1
   [junit4]   2> 658036 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 658037 INFO  (zkCallback-1285-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 658037 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"http://127.0.0.1:43168",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 658138 INFO  (zkCallback-1285-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 658187 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are http://127.0.0.1:43168/collection1/ and leader is http://127.0.0.1:43168/collection1/
   [junit4]   2> 658188 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=http://127.0.0.1:43168
   [junit4]   2> 658188 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 658188 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 658188 INFO  (coreZkRegister-2579-thread-1-processing-n:127.0.0.1:43168_ x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:43168_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 658188 INFO  (zkCallback-1285-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 658189 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43168",
   [junit4]   2>   "node_name":"127.0.0.1:43168_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 658189 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"http://127.0.0.1:43168",
   [junit4]   2>   "node_name":"127.0.0.1:43168_",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 658290 INFO  (zkCallback-1285-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 658373 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 658373 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 658374 INFO  (zkCallback-1287-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@57c9b6c4 name:ZooKeeperConnection Watcher:127.0.0.1:53253/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 658374 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 658374 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 658374 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 658375 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 658375 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 658375 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 658376 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 658376 INFO  (zkCallback-1288-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4959f279 name:ZooKeeperConnection Watcher:127.0.0.1:53253/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 658376 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 658377 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 658377 INFO  (zkCallback-1285-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 658378 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 658378 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 658440 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/shard-1-001/cores/collection1
   [junit4]   2> 658440 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/shard-1-001
   [junit4]   2> 658441 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 658442 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7f0020e6{/,null,AVAILABLE}
   [junit4]   2> 658442 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.e.j.s.ServerConnector Started ServerConnector@3d0631c1{HTTP/1.1}{127.0.0.1:33236}
   [junit4]   2> 658442 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.e.j.s.Server Started @660193ms
   [junit4]   2> 658442 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=33236, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/shard-1-001/cores}
   [junit4]   2> 658442 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@4e0e2f2a
   [junit4]   2> 658443 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/shard-1-001/'
   [junit4]   2> 658450 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 658451 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 658451 INFO  (zkCallback-1289-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@7cf06901 name:ZooKeeperConnection Watcher:127.0.0.1:53253/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 658451 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 658452 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 658452 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 658452 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/shard-1-001/solr.xml
   [junit4]   2> 658455 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/shard-1-001/cores
   [junit4]   2> 658455 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.CoreContainer New CoreContainer 159111276
   [junit4]   2> 658455 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/shard-1-001/]
   [junit4]   2> 658455 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/shard-1-001/lib
   [junit4]   2> 658455 WARN  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_D59D8B8473EC8B00-001/shard-1-001/lib).
   [junit4]   2> 658459 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 658460 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 658460 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 658460 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 658460 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:53253/solr
   [junit4]   2> 658460 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 658460 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 658461 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 658462 INFO  (zkCallback-1291-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@259a0ce8 name:ZooKeeperConnection Watcher:127.0.0.1:53253 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 658462 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 658462 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 658463 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:33236_    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 658463 INFO  (zkCallback-1292-thread-1-processing-n:127.0.0.1:33236_) [n:127.0.0.1:33236_    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@5f1fa804 name:ZooKeeperConnection Watcher:127.0.0.1:53253/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 658463 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:33236_    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 658465 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:33236_    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 658479 INFO  (OverseerStateUpdate-94310561898364932-127.0.0.1:43168_-n_0000000000) [n:127.0.0.1:43168_    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 658479 INFO  (zkCallback-1285-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 658479 INFO  (zkCallback-1292-thread-1-processing-n:127.0.0.1:33236_) [n:127.0.0.1:33236_    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 658479 INFO  (zkCallback-1287-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 659466 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:33236_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33236_
   [junit4]   2> 659467 INFO  (TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]) [n:127.0.0.1:33236_    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:33236_
   [junit4]   2> 659467 INFO  (zkCallback-1287-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 659467 INFO  (zkCallback-1292-thread-1-processing-n:127.0.0.1:33236_) [n:127.0.0.1:33236_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 659467 INFO  (zkCallback-1285-thread-1-processing-n:127.0.0.1:43168_) [n:127.0.0.1:43168_    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeC

[...truncated too long message...]

ce with: ant test  -Dtestcase=CollectionsAPIDistributedZkTest -Dtests.seed=D59D8B8473EC8B00 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar_SD -Dtests.timezone=America/Port-au-Prince -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR   0.00s J1 | CollectionsAPIDistributedZkTest (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 5 threads leaked from SUITE scope at org.apache.solr.cloud.CollectionsAPIDistributedZkTest: 
   [junit4]    >    1) Thread[id=6699, name=zkCallback-1312-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    2) Thread[id=6697, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]-SendThread(127.0.0.1:53253), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   [junit4]    >    3) Thread[id=6747, name=zkCallback-1312-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    4) Thread[id=6758, name=zkCallback-1312-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    5) Thread[id=6698, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]-EventThread, state=WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:494)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D59D8B8473EC8B00]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=6699, name=zkCallback-1312-thread-1, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    2) Thread[id=6697, name=TEST-CollectionsAPIDistributedZkTest.test-seed#[D59D8B8473EC8B00]-SendThread(127.0.0.1:53253), state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:940)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1003)
   [junit4]    >    3) Thread[id=6747, name=zkCallback-1312-thread-2, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    >    4) Thread[id=6758, name=zkCallback-1312-thread-3, state=TIMED_WAITING, group=TGRP-CollectionsAPIDistributedZkTest]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
   [junit4]    >         at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
   [junit4]    >         at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
   [junit4]    >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]    >         at java.lang.Thread.run(Thread.java:745)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D59D8B8473EC8B00]:0)
   [junit4] Completed [255/539] on J1 in 84.63s, 1 test, 3 errors <<< FAILURES!

[...truncated 888 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:716: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:660: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:230: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:514: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1429: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:984: There were test failures: 539 suites, 2126 tests, 2 suite-level errors, 1 error, 992 ignored (29 assumptions)

Total time: 32 minutes 21 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Linux (32bit/jdk1.8.0_51) - Build # 13781 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13781/
Java: 32bit/jdk1.8.0_51 -server -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.CollectionStateFormat2Test.test

Error Message:
Error from server at https://127.0.0.1:58877/n_tyg/qk: Could not find collection : myExternColl

Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:58877/n_tyg/qk: Could not find collection : myExternColl
	at __randomizedtesting.SeedInfo.seed([71B500104404143F:F9E13FCAEAF879C7]:0)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
	at org.apache.solr.cloud.CollectionStateFormat2Test.testZkNodeLocation(CollectionStateFormat2Test.java:84)
	at org.apache.solr.cloud.CollectionStateFormat2Test.test(CollectionStateFormat2Test.java:40)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)




Build Log:
[...truncated 9932 lines...]
   [junit4] Suite: org.apache.solr.cloud.CollectionStateFormat2Test
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/init-core-data-001
   [junit4]   2> 584443 INFO  (SUITE-CollectionStateFormat2Test-seed#[71B500104404143F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false)
   [junit4]   2> 584443 INFO  (SUITE-CollectionStateFormat2Test-seed#[71B500104404143F]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /n_tyg/qk
   [junit4]   2> 584444 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 584444 INFO  (Thread-2334) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 584444 INFO  (Thread-2334) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 584544 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.ZkTestServer start zk server on port:36846
   [junit4]   2> 584545 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 584545 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 584546 INFO  (zkCallback-465-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1bb1243 name:ZooKeeperConnection Watcher:127.0.0.1:36846 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 584546 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 584547 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 584547 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /solr
   [junit4]   2> 584548 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 584548 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 584549 INFO  (zkCallback-466-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@906b2f name:ZooKeeperConnection Watcher:127.0.0.1:36846/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 584549 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 584549 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 584549 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1
   [junit4]   2> 584550 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/collection1/shards
   [junit4]   2> 584550 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection
   [junit4]   2> 584551 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/shards
   [junit4]   2> 584551 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 584551 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.xml
   [junit4]   2> 584552 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 584552 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/schema.xml
   [junit4]   2> 584553 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 584553 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 584553 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 584553 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/stopwords.txt
   [junit4]   2> 584554 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 584554 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/protwords.txt
   [junit4]   2> 584554 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 584554 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/currency.xml
   [junit4]   2> 584555 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 584555 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/enumsConfig.xml
   [junit4]   2> 584555 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 584556 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/open-exchange-rates.json
   [junit4]   2> 584556 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 584556 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 584557 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 584557 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/old_synonyms.txt
   [junit4]   2> 584557 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 584557 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient makePath: /configs/conf1/synonyms.txt
   [junit4]   2> 584558 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 584558 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 584559 INFO  (zkCallback-467-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1cbb478 name:ZooKeeperConnection Watcher:127.0.0.1:36846/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 584559 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 584559 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 584608 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1
   [junit4]   2> 584609 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 584610 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@eacc8{/n_tyg/qk,null,AVAILABLE}
   [junit4]   2> 584612 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.e.j.s.ServerConnector Started ServerConnector@1144733{SSL-http/1.1}{127.0.0.1:39713}
   [junit4]   2> 584612 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.e.j.s.Server Started @586413ms
   [junit4]   2> 584612 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/tempDir-001/control/data, hostContext=/n_tyg/qk, hostPort=39713, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores}
   [junit4]   2> 584612 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@e2f2a
   [junit4]   2> 584613 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/'
   [junit4]   2> 584620 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 584621 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 584621 INFO  (zkCallback-468-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1b740eb name:ZooKeeperConnection Watcher:127.0.0.1:36846/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 584621 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 584622 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 584622 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 584622 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/solr.xml
   [junit4]   2> 584625 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores
   [junit4]   2> 584625 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.CoreContainer New CoreContainer 27923729
   [junit4]   2> 584625 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/]
   [junit4]   2> 584626 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/lib
   [junit4]   2> 584626 WARN  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/lib).
   [junit4]   2> 584630 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 584631 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 584631 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 584631 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 584632 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36846/solr
   [junit4]   2> 584632 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 584632 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 584632 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 584633 INFO  (zkCallback-470-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@f227cc name:ZooKeeperConnection Watcher:127.0.0.1:36846 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 584633 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 584633 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 584634 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 584635 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1696895 name:ZooKeeperConnection Watcher:127.0.0.1:36846/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 584635 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 584635 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue
   [junit4]   2> 584636 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-queue-work
   [junit4]   2> 584637 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-running
   [junit4]   2> 584637 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-completed
   [junit4]   2> 584638 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/collection-map-failure
   [junit4]   2> 584638 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes
   [junit4]   2> 584639 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /aliases.json
   [junit4]   2> 584639 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /clusterstate.json
   [junit4]   2> 584639 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /security.json
   [junit4]   2> 584640 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39713_n_tyg%2Fqk
   [junit4]   2> 584640 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:39713_n_tyg%2Fqk
   [junit4]   2> 584640 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect
   [junit4]   2> 584641 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/election
   [junit4]   2> 584641 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 584641 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000
   [junit4]   2> 584642 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39713_n_tyg%2Fqk
   [junit4]   2> 584642 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /overseer_elect/leader
   [junit4]   2> 584642 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.Overseer Overseer (id=94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) starting
   [junit4]   2> 584643 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /overseer/queue-work
   [junit4]   2> 584644 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.OverseerAutoReplicaFailoverThread Starting OverseerAutoReplicaFailoverThread autoReplicaFailoverWorkLoopDelay=10000 autoReplicaFailoverWaitAfterExpiration=10000 autoReplicaFailoverBadNodeExpiration=60000
   [junit4]   2> 584645 INFO  (OverseerCollectionProcessor-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.OverseerProcessor Process current queue of overseer operations
   [junit4]   2> 584645 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 584645 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.Overseer Starting to work on the main queue
   [junit4]   2> 584665 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 584665 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 584666 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.CoresLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores
   [junit4]   2> 584666 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1, collection=control_collection, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 584666 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.CoresLocator Found core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1/
   [junit4]   2> 584666 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 584667 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.s.SolrDispatchFilter user.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 584667 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 584667 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 584667 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 584667 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 584667 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 584668 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39713/n_tyg/qk",
   [junit4]   2>   "node_name":"127.0.0.1:39713_n_tyg%2Fqk",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 0
   [junit4]   2> 584668 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39713/n_tyg/qk",
   [junit4]   2>   "node_name":"127.0.0.1:39713_n_tyg%2Fqk",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 584668 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.o.ClusterStateMutator building a new cName: control_collection
   [junit4]   2> 584668 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 584669 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 585668 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 585668 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.ZkController Check for collection zkNode:control_collection
   [junit4]   2> 585668 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.ZkController Collection zkNode exists
   [junit4]   2> 585668 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 585668 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 585668 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1/'
   [junit4]   2> 585675 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.Config loaded config solrconfig.xml with version 0 
   [junit4]   2> 585678 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.SolrConfig current version of requestparams : -1
   [junit4]   2> 585681 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 6.0.0
   [junit4]   2> 585688 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.Config Loaded SolrConfig: solrconfig.xml
   [junit4]   2> 585689 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.IndexSchema Reading Solr Schema from /configs/conf1/schema.xml
   [junit4]   2> 585692 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 585776 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Initialized with rates=open-exchange-rates.json, refreshInterval=1440.
   [junit4]   2> 585780 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.IndexSchema default search field in schema is text
   [junit4]   2> 585781 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.IndexSchema unique key field: id
   [junit4]   2> 585784 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 585785 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.FileExchangeRateProvider Reloading exchange rates from file currency.xml
   [junit4]   2> 585786 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 585786 WARN  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 585787 WARN  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 585787 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Reloading exchange rates from open-exchange-rates.json
   [junit4]   2> 585787 WARN  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Unknown key IMPORTANT NOTE
   [junit4]   2> 585787 WARN  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.s.OpenExchangeRatesOrgProvider Expected key, got STRING
   [junit4]   2> 585788 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.ConfigSetProperties Did not find ConfigSet properties, assuming default properties: Can't find resource 'configsetprops.json' in classpath or '/configs/conf1', cwd=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 585788 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 585788 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore org.apache.solr.core.MockDirectoryFactory
   [junit4]   2> 585788 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1/], dataDir=[null]
   [junit4]   2> 585788 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@f9ebe4
   [junit4]   2> 585789 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1/data
   [junit4]   2> 585789 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore New index directory detected: old=null new=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1/data/index/
   [junit4]   2> 585789 WARN  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Solr index directory '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1/data/index' doesn't exist. Creating new index...
   [junit4]   2> 585789 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CachingDirectoryFactory return new directory for /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1/data/index
   [junit4]   2> 585790 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=47, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.43752504289479754]
   [junit4]   2> 585790 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onCommit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@6b0def lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@89d7e6),segFN=segments_1,generation=1}
   [junit4]   2> 585790 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 585791 INFO  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Looking for old index directories to cleanup for core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1/data/
   [junit4]   2> 585791 WARN  (OldIndexDirectoryCleanupThreadForCore-collection1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.DirectoryFactory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/control-001/cores/collection1/data/ does not point to a valid data directory; skipping clean-up of old index directories.
   [junit4]   2> 585793 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "nodistrib"
   [junit4]   2> 585793 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "dedupe"
   [junit4]   2> 585793 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "dedupe"
   [junit4]   2> 585793 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "stored_sig"
   [junit4]   2> 585793 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "stored_sig"
   [junit4]   2> 585793 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-explicit"
   [junit4]   2> 585793 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain creating updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 585793 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.UpdateRequestProcessorChain inserting DistributedUpdateProcessorFactory into updateRequestProcessorChain "distrib-dup-test-chain-implicit"
   [junit4]   2> 585794 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore no updateRequestProcessorChain defined as default, creating implicit default
   [junit4]   2> 585794 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 585795 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 585795 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 585796 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.l.XMLLoader xsltCacheLifetimeSeconds=60
   [junit4]   2> 585797 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.RequestHandlers Registered paths: /admin/mbeans,standard,/update/csv,/update/json/docs,/admin/luke,/admin/segments,/get,/admin/system,/replication,/admin/properties,/config,/schema,/admin/plugins,/admin/logging,/update/json,/admin/threads,/admin/ping,/update,/admin/file
   [junit4]   2> 585798 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Using default statsCache cache: org.apache.solr.search.stats.LocalStatsCache
   [junit4]   2> 585798 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 585798 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 585799 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Hard AutoCommit: disabled
   [junit4]   2> 585799 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore Soft AutoCommit: disabled
   [junit4]   2> 585799 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 585799 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore SolrDeletionPolicy.onInit: commits: num=1
   [junit4]   2> 	commit{dir=MockDirectoryWrapper(RAMDirectory@6b0def lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@89d7e6),segFN=segments_1,generation=1}
   [junit4]   2> 585799 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore newest commit generation = 1
   [junit4]   2> 585799 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.s.SolrIndexSearcher Opening Searcher@59aa41[collection1] main
   [junit4]   2> 585800 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader Load collection config from:/collections/control_collection
   [junit4]   2> 585800 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.ZkStateReader path=/collections/control_collection configName=conf1 specified config exists in ZooKeeper
   [junit4]   2> 585800 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Setting up ZooKeeper-based storage for the RestManager with znodeBase: /configs/conf1
   [junit4]   2> 585801 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 585801 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing RestManager with initArgs: {}
   [junit4]   2> 585801 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Reading _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 585801 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage No data found for znode /configs/conf1/_rest_managed.json
   [junit4]   2> 585801 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 585801 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.r.RestManager Initializing 0 registered ManagedResources
   [junit4]   2> 585801 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 585802 INFO  (searcherExecutor-2305-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@59aa41[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 585802 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Looking up max value of version field to seed version buckets
   [junit4]   2> 585802 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo Refreshing highest value of _version_ for 65536 version buckets from index
   [junit4]   2> 585802 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.VersionInfo No terms found for _version_, cannot seed version bucket highest value from index
   [junit4]   2> 585802 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1508966036660027392
   [junit4]   2> 585804 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.UpdateLog Took 1.0ms to seed version buckets with highest version 1508966036660027392
   [junit4]   2> 585804 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController watch zkdir /configs/conf1
   [junit4]   2> 585804 INFO  (coreLoadExecutor-2304-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.CoreContainer registering core: collection1
   [junit4]   2> 585804 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController Register replica - core:collection1 address:https://127.0.0.1:39713/n_tyg/qk collection:control_collection shard:shard1
   [junit4]   2> 585805 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leader_elect/shard1/election
   [junit4]   2> 585806 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.LeaderElector Joined leadership election with path: /collections/control_collection/leader_elect/shard1/election/94310377202319365-core_node1-n_0000000000
   [junit4]   2> 585806 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Running the leader process for shard shard1
   [junit4]   2> 585807 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 585807 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 585807 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 585807 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:39713/n_tyg/qk/collection1/
   [junit4]   2> 585807 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection"} current state version: 1
   [junit4]   2> 585807 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 585807 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy https://127.0.0.1:39713/n_tyg/qk/collection1/ has no replicas
   [junit4]   2> 585807 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:39713/n_tyg/qk/collection1/ shard1
   [junit4]   2> 585807 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.c.SolrZkClient makePath: /collections/control_collection/leaders/shard1
   [junit4]   2> 585809 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 585809 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"leader",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "base_url":"https://127.0.0.1:39713/n_tyg/qk",
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "state":"active"} current state version: 1
   [junit4]   2> 585910 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 585959 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController We are https://127.0.0.1:39713/n_tyg/qk/collection1/ and leader is https://127.0.0.1:39713/n_tyg/qk/collection1/
   [junit4]   2> 585959 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController No LogReplay needed for core=collection1 baseURL=https://127.0.0.1:39713/n_tyg/qk
   [junit4]   2> 585960 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 585960 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController publishing state=active
   [junit4]   2> 585960 INFO  (coreZkRegister-2298-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk x:collection1 s:shard1 c:control_collection r:core_node1) [n:127.0.0.1:39713_n_tyg%2Fqk c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 585960 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 585961 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39713/n_tyg/qk",
   [junit4]   2>   "node_name":"127.0.0.1:39713_n_tyg%2Fqk",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"} current state version: 2
   [junit4]   2> 585961 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.o.ReplicaMutator Update state numShards=1 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "core_node_name":"core_node1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:39713/n_tyg/qk",
   [junit4]   2>   "node_name":"127.0.0.1:39713_n_tyg%2Fqk",
   [junit4]   2>   "numShards":"1",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "collection":"control_collection",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 586062 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 586169 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 586169 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 586170 INFO  (zkCallback-473-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@4ba148 name:ZooKeeperConnection Watcher:127.0.0.1:36846/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 586170 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 586171 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 586171 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 586172 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 586172 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 586172 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 586172 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 586173 INFO  (zkCallback-474-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@12e1d28 name:ZooKeeperConnection Watcher:127.0.0.1:36846/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 586173 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 586173 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 586174 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 586174 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "operation":"create",
   [junit4]   2>   "name":"collection1",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "stateFormat":"2"} current state version: 3
   [junit4]   2> 586174 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.o.ClusterStateMutator building a new cName: collection1
   [junit4]   2> 586232 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/cores/collection1
   [junit4]   2> 586233 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001
   [junit4]   2> 586233 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.e.j.s.Server jetty-9.2.11.v20150529
   [junit4]   2> 586234 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b61577{/n_tyg/qk,null,AVAILABLE}
   [junit4]   2> 586236 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.e.j.s.ServerConnector Started ServerConnector@3a93ed{SSL-http/1.1}{127.0.0.1:41130}
   [junit4]   2> 586236 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.e.j.s.Server Started @588037ms
   [junit4]   2> 586236 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/n_tyg/qk, hostPort=41130, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/cores}
   [junit4]   2> 586237 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init(): sun.misc.Launcher$AppClassLoader@e2f2a
   [junit4]   2> 586237 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.SolrResourceLoader new SolrResourceLoader for directory: '/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/'
   [junit4]   2> 586244 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 586245 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 586246 INFO  (zkCallback-475-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@f9909 name:ZooKeeperConnection Watcher:127.0.0.1:36846/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 586246 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 586246 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 586247 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 586247 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/solr.xml
   [junit4]   2> 586250 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.CoresLocator Config-defined core root directory: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/cores
   [junit4]   2> 586250 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.CoreContainer New CoreContainer 24339156
   [junit4]   2> 586250 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.CoreContainer Loading cores into CoreContainer [instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/]
   [junit4]   2> 586250 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.CoreContainer loading shared library: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/lib
   [junit4]   2> 586251 WARN  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.SolrResourceLoader Can't find (or read) directory to add to classloader: lib (resolved as: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/lib).
   [junit4]   2> 586254 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.h.c.HttpShardHandlerFactory created with socketTimeout : 90000,urlScheme : ,connTimeout : 15000,maxConnectionsPerHost : 20,maxConnections : 10000,corePoolSize : 0,maximumPoolSize : 2147483647,maxThreadIdleTime : 5,sizeOfQueue : -1,fairnessPolicy : false,useRetries : false,
   [junit4]   2> 586255 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.u.UpdateShardHandler Creating UpdateShardHandler HTTP client with params: socketTimeout=340000&connTimeout=45000&retry=true
   [junit4]   2> 586256 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.l.LogWatcher SLF4J impl is org.slf4j.impl.Log4jLoggerFactory
   [junit4]   2> 586256 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.l.LogWatcher Registering Log Listener [Log4j (org.slf4j.impl.Log4jLoggerFactory)]
   [junit4]   2> 586256 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36846/solr
   [junit4]   2> 586256 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.ZkController zkHost includes chroot
   [junit4]   2> 586257 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkCredentialsProvider
   [junit4]   2> 586257 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 586258 INFO  (zkCallback-477-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@11fa55a name:ZooKeeperConnection Watcher:127.0.0.1:36846 got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 586258 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 586258 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.a.s.c.c.SolrZkClient Using default ZkACLProvider
   [junit4]   2> 586259 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.c.ConnectionManager Waiting for client to connect to ZooKeeper
   [junit4]   2> 586259 INFO  (zkCallback-478-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@144018 name:ZooKeeperConnection Watcher:127.0.0.1:36846/solr got event WatchedEvent state:SyncConnected type:None path:null path:null type:None
   [junit4]   2> 586260 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper
   [junit4]   2> 586261 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.c.ZkStateReader Updating cluster state from ZooKeeper... 
   [junit4]   2> 586275 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.o.ZkStateWriter going to create_collection /collections/collection1/state.json
   [junit4]   2> 586276 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 586276 INFO  (zkCallback-473-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 586276 INFO  (zkCallback-478-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/clusterstate.json, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 587263 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41130_n_tyg%2Fqk
   [junit4]   2> 587263 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.c.SolrZkClient makePath: /live_nodes/127.0.0.1:41130_n_tyg%2Fqk
   [junit4]   2> 587263 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 587263 INFO  (zkCallback-473-thread-1) [    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 587264 INFO  (zkCallback-478-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.c.ZkStateReader A live node change: WatchedEvent state:SyncConnected type:NodeChildrenChanged path:/live_nodes, has occurred - updating... (live nodes size: 1)
   [junit4]   2> 587264 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 587264 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.LeaderElector Joined leadership election with path: /overseer_elect/election/94310377202319370-127.0.0.1:41130_n_tyg%2Fqk-n_0000000001
   [junit4]   2> 587264 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.LeaderElector Watching path /overseer_elect/election/94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000 to know if I could be the leader
   [junit4]   2> 587286 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.CoreContainer Security conf doesn't exist. Skipping setup for authorization module.
   [junit4]   2> 587286 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.CoreContainer No authentication plugin used.
   [junit4]   2> 587287 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.CoresLocator Looking for core definitions underneath /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/cores
   [junit4]   2> 587287 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.SolrCore Created CoreDescriptor: {name=collection1, config=solrconfig.xml, transient=false, schema=schema.xml, loadOnStartup=true, configSetProperties=configsetprops.json, instanceDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/cores/collection1, collection=collection1, absoluteInstDir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/cores/collection1/, coreNodeName=, dataDir=data/, shard=}
   [junit4]   2> 587287 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.CoresLocator Found core collection1 in /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001/shard-1-001/cores/collection1/
   [junit4]   2> 587288 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.CoresLocator Found 1 core definitions
   [junit4]   2> 587288 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.s.SolrDispatchFilter user.dir=/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1
   [junit4]   2> 587288 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.s.SolrDispatchFilter SolrDispatchFilter.init() done
   [junit4]   2> 587288 INFO  (coreLoadExecutor-2315-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk c:collection1   x:collection1] o.a.s.c.ZkController publishing state=down
   [junit4]   2> 587288 INFO  (coreLoadExecutor-2315-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk c:collection1   x:collection1] o.a.s.c.ZkController numShards not found on descriptor - reading it from system property
   [junit4]   2> 587289 INFO  (zkCallback-471-thread-1-processing-n:127.0.0.1:39713_n_tyg%2Fqk) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.DistributedQueue NodeChildrenChanged fired on path /overseer/queue state SyncConnected
   [junit4]   2> 587289 INFO  (coreLoadExecutor-2315-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk c:collection1   x:collection1] o.a.s.c.ZkController Registering watch for collection collection1
   [junit4]   2> 587289 INFO  (coreLoadExecutor-2315-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk c:collection1   x:collection1] o.a.s.c.c.ZkStateReader addZkWatch collection1
   [junit4]   2> 587289 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.Overseer processMessage: queueSize: 1, message = {
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:41130/n_tyg/qk",
   [junit4]   2>   "node_name":"127.0.0.1:41130_n_tyg%2Fqk",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"} current state version: 4
   [junit4]   2> 587289 INFO  (coreLoadExecutor-2315-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk c:collection1   x:collection1] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 0 
   [junit4]   2> 587289 INFO  (coreLoadExecutor-2315-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk c:collection1   x:collection1] o.a.s.c.ZkController look for our core node name
   [junit4]   2> 587290 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.o.ReplicaMutator Update state numShards=2 message={
   [junit4]   2>   "core":"collection1",
   [junit4]   2>   "roles":null,
   [junit4]   2>   "base_url":"https://127.0.0.1:41130/n_tyg/qk",
   [junit4]   2>   "node_name":"127.0.0.1:41130_n_tyg%2Fqk",
   [junit4]   2>   "numShards":"2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "shard":null,
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "operation":"state"}
   [junit4]   2> 587290 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.o.ReplicaMutator Collection already exists with numShards=2
   [junit4]   2> 587290 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 587391 INFO  (OverseerStateUpdate-94310377202319365-127.0.0.1:39713_n_tyg%2Fqk-n_0000000000) [n:127.0.0.1:39713_n_tyg%2Fqk    ] o.a.s.c.o.ZkStateWriter going to update_collection /collections/collection1/state.json version: 0
   [junit4]   2> 587391 INFO  (zkCallback-478-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.c.ZkStateReader A cluster state change: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json for collection collection1 has occurred - updating... (live nodes size: 2)
   [junit4]   2> 587391 INFO  (zkCallback-478-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk    ] o.a.s.c.c.ZkStateReader Updating data for collection1 to ver 1 
   [junit4]   2> 588290 INFO  (coreLoadExecutor-2315-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk c:collection1   x:collection1] o.a.s.c.ZkController waiting to find shard id in clusterstate for collection1
   [junit4]   2> 588290 INFO  (coreLoadExecutor-2315-thread-1-processing-n:127.0.0.1:41130_n_tyg%2Fqk) [n:127.0.0.1:41130_n_tyg%2Fqk c:collection1   x:collection1]

[...truncated too long message...]

 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:159)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:390)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3$1.run(SolrZkClient.java:269)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor$1.run(ExecutorUtil.java:210)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> Caused by: org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /collections
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:127)
   [junit4]   2> 	at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
   [junit4]   2> 	at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:302)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$4.execute(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:61)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.exists(SolrZkClient.java:299)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:493)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:463)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient.makePath(SolrZkClient.java:450)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase$1.execute(ElectionContext.java:141)
   [junit4]   2> 	at org.apache.solr.common.util.RetryUtil.retryOnThrowable(RetryUtil.java:31)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContextBase.runLeaderProcess(ElectionContext.java:137)
   [junit4]   2> 	... 12 more
   [junit4]   2> 
   [junit4]   2> 641547 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.e.j.s.ServerConnector Stopped ServerConnector@137707c{SSL-http/1.1}{127.0.0.1:0}
   [junit4]   2> 641547 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1f0f948{/n_tyg/qk,null,UNAVAILABLE}
   [junit4]   2> 641548 INFO  (TEST-CollectionStateFormat2Test.test-seed#[71B500104404143F]) [n:127.0.0.1:53248_n_tyg%2Fqk c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36846 36846
   [junit4]   2> 641623 INFO  (Thread-2334) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36846 36846
   [junit4]   2> 641623 WARN  (Thread-2334) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	5	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/collections/collection1/state.json
   [junit4]   2> 	4	/solr/collections/myExternColl/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/live_nodes
   [junit4]   2> 	4	/solr/overseer/queue
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CollectionStateFormat2Test -Dtests.method=test -Dtests.seed=71B500104404143F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr -Dtests.timezone=Australia/Sydney -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   57.2s J1 | CollectionStateFormat2Test.test <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:58877/n_tyg/qk: Could not find collection : myExternColl
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([71B500104404143F:F9E13FCAEAF879C7]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:560)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:234)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:226)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:372)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:325)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1086)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:857)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:800)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1220)
   [junit4]    > 	at org.apache.solr.cloud.CollectionStateFormat2Test.testZkNodeLocation(CollectionStateFormat2Test.java:84)
   [junit4]    > 	at org.apache.solr.cloud.CollectionStateFormat2Test.test(CollectionStateFormat2Test.java:40)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:963)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:938)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 641629 INFO  (SUITE-CollectionStateFormat2Test-seed#[71B500104404143F]-worker) [n:127.0.0.1:53248_n_tyg%2Fqk c:collection1 s:shard1 r:core_node4 x:collection1] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionStateFormat2Test_71B500104404143F-001
   [junit4]   2> Aug 08, 2015 7:30:09 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53), sim=RandomSimilarityProvider(queryNorm=false,coord=yes): {}, locale=sr, timezone=Australia/Sydney
   [junit4]   2> NOTE: Linux 3.16.0-44-generic i386/Oracle Corporation 1.8.0_51 (32-bit)/cpus=12,threads=1,free=67564672,total=237764608
   [junit4]   2> NOTE: All tests run in this JVM: [WordBreakSolrSpellCheckerTest, TestOverriddenPrefixQueryForCustomFieldType, TestStressUserVersions, TestRestoreCore, BaseCdcrDistributedZkTest, BadComponentTest, TestLFUCache, CacheHeaderTest, HLLSerializationTest, SpellCheckComponentTest, ShowFileRequestHandlerTest, TestManagedSchemaDynamicFieldResource, TestSolrQueryParserDefaultOperatorResource, SpatialRPTFieldTypeTest, ShardRoutingCustomTest, DistribJoinFromCollectionTest, DocValuesMultiTest, TestOmitPositions, UpdateParamsTest, TestDynamicFieldResource, TestMiniSolrCloudClusterSSL, TestCustomDocTransformer, TestHashPartitioner, TestComponentsName, TestCrossCoreJoin, DistributedTermsComponentTest, ConvertedLegacyTest, SSLMigrationTest, FileUtilsTest, IndexSchemaRuntimeFieldTest, DistributedFacetPivotWhiteBoxTest, TestIndexSearcher, SolrCmdDistributorTest, TestBlendedInfixSuggestions, HdfsRecoverLeaseTest, TestRTGBase, DistributedQueueTest, DistributedIntervalFacetingTest, SecurityConfHandlerTest, ReturnFieldsTest, TestManagedSynonymFilterFactory, LukeRequestHandlerTest, DistributedMLTComponentTest, TestConfigSets, AsyncMigrateRouteKeyTest, RequestLoggingTest, TestFoldingMultitermQuery, SpatialFilterTest, SliceStateTest, ZkControllerTest, VMParamsZkACLAndCredentialsProvidersTest, FieldMutatingUpdateProcessorTest, TestChildDocTransformer, TestBlobHandler, SpatialHeatmapFacetsTest, TestDistributedGrouping, RuleEngineTest, SuggestComponentTest, TestSortingResponseWriter, SystemInfoHandlerTest, ResourceLoaderTest, TestRTimer, HttpPartitionTest, PKIAuthenticationIntegrationTest, CleanupOldIndexTest, TestPHPSerializedResponseWriter, TestSimpleTrackingShardHandler, TestCloudManagedSchema, CollectionStateFormat2Test]
   [junit4] Completed [184/539] on J1 in 57.95s, 1 test, 1 error <<< FAILURES!

[...truncated 1127 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:716: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:660: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/build.xml:230: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/solr/common-build.xml:514: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1429: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:984: There were test failures: 539 suites, 2126 tests, 1 error, 67 ignored (31 assumptions)

Total time: 48 minutes 13 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any



[JENKINS] Lucene-Solr-trunk-Linux (64bit/jdk1.8.0_51) - Build # 13780 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: http://jenkins.thetaphi.de/job/Lucene-Solr-trunk-Linux/13780/
Java: 64bit/jdk1.8.0_51 -XX:-UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.lucene.index.TestIndexWriterOutOfFileDescriptors.test

Error Message:
this writer hit an unrecoverable error; cannot commit

Stack Trace:
java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot commit
	at __randomizedtesting.SeedInfo.seed([BE3D1E7902A48921:366921A3AC58E4D9]:0)
	at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2777)
	at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2963)
	at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1066)
	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1109)
	at org.apache.lucene.index.TestIndexWriterOutOfFileDescriptors.test(TestIndexWriterOutOfFileDescriptors.java:87)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:497)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1627)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:836)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:872)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:886)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:50)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:49)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:798)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:458)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:845)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$3.evaluate(RandomizedRunner.java:747)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$4.evaluate(RandomizedRunner.java:781)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:792)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:46)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:42)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:39)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:54)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:65)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:55)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:365)
	at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: a random IOException (_f_Lucene50_0.doc)
	at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowIOExceptionOnOpen(MockDirectoryWrapper.java:456)
	at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:635)
	at org.apache.lucene.codecs.lucene50.Lucene50PostingsReader.<init>(Lucene50PostingsReader.java:81)
	at org.apache.lucene.codecs.lucene50.Lucene50PostingsFormat.fieldsProducer(Lucene50PostingsFormat.java:443)
	at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:261)
	at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:341)
	at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:104)
	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:65)
	at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
	at org.apache.lucene.index.ReadersAndUpdates.getReaderForMerge(ReadersAndUpdates.java:617)
	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4006)
	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3650)
	at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
	at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)




Build Log:
[...truncated 1492 lines...]
   [junit4] Suite: org.apache.lucene.index.TestIndexWriterOutOfFileDescriptors
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestIndexWriterOutOfFileDescriptors -Dtests.method=test -Dtests.seed=BE3D1E7902A48921 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=pl -Dtests.timezone=America/Boa_Vista -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   2.61s J2 | TestIndexWriterOutOfFileDescriptors.test <<<
   [junit4]    > Throwable #1: java.lang.IllegalStateException: this writer hit an unrecoverable error; cannot commit
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([BE3D1E7902A48921:366921A3AC58E4D9]:0)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.prepareCommitInternal(IndexWriter.java:2777)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.commitInternal(IndexWriter.java:2963)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.shutdown(IndexWriter.java:1066)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.close(IndexWriter.java:1109)
   [junit4]    > 	at org.apache.lucene.index.TestIndexWriterOutOfFileDescriptors.test(TestIndexWriterOutOfFileDescriptors.java:87)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:745)
   [junit4]    > Caused by: java.io.IOException: a random IOException (_f_Lucene50_0.doc)
   [junit4]    > 	at org.apache.lucene.store.MockDirectoryWrapper.maybeThrowIOExceptionOnOpen(MockDirectoryWrapper.java:456)
   [junit4]    > 	at org.apache.lucene.store.MockDirectoryWrapper.openInput(MockDirectoryWrapper.java:635)
   [junit4]    > 	at org.apache.lucene.codecs.lucene50.Lucene50PostingsReader.<init>(Lucene50PostingsReader.java:81)
   [junit4]    > 	at org.apache.lucene.codecs.lucene50.Lucene50PostingsFormat.fieldsProducer(Lucene50PostingsFormat.java:443)
   [junit4]    > 	at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat$FieldsReader.<init>(PerFieldPostingsFormat.java:261)
   [junit4]    > 	at org.apache.lucene.codecs.perfield.PerFieldPostingsFormat.fieldsProducer(PerFieldPostingsFormat.java:341)
   [junit4]    > 	at org.apache.lucene.index.SegmentCoreReaders.<init>(SegmentCoreReaders.java:104)
   [junit4]    > 	at org.apache.lucene.index.SegmentReader.<init>(SegmentReader.java:65)
   [junit4]    > 	at org.apache.lucene.index.ReadersAndUpdates.getReader(ReadersAndUpdates.java:145)
   [junit4]    > 	at org.apache.lucene.index.ReadersAndUpdates.getReaderForMerge(ReadersAndUpdates.java:617)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.mergeMiddle(IndexWriter.java:4006)
   [junit4]    > 	at org.apache.lucene.index.IndexWriter.merge(IndexWriter.java:3650)
   [junit4]    > 	at org.apache.lucene.index.ConcurrentMergeScheduler.doMerge(ConcurrentMergeScheduler.java:588)
   [junit4]    > 	at org.apache.lucene.index.ConcurrentMergeScheduler$MergeThread.run(ConcurrentMergeScheduler.java:626)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build/core/test/J2/temp/lucene.index.TestIndexWriterOutOfFileDescriptors_BE3D1E7902A48921-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene53): {date=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), docid_int=PostingsFormat(name=LuceneVarGapFixedInterval), docid=PostingsFormat(name=LuceneVarGapFixedInterval), titleTokenized=PostingsFormat(name=Asserting), body=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), title=Lucene50(blocksize=128)}, docValues:{docid_intDV=DocValuesFormat(name=Asserting), titleDV=DocValuesFormat(name=Lucene50)}, sim=RandomSimilarityProvider(queryNorm=true,coord=yes): {titleTokenized=DefaultSimilarity, body=DFR GB1}, locale=pl, timezone=America/Boa_Vista
   [junit4]   2> NOTE: Linux 3.16.0-44-generic amd64/Oracle Corporation 1.8.0_51 (64-bit)/cpus=12,threads=1,free=276521064,total=508952576
   [junit4]   2> NOTE: All tests run in this JVM: [TestIndexFileDeleter, TestTopDocsCollector, TestCloseableThreadLocal, TestCharsRefBuilder, TestSearchWithThreads, TestRecyclingByteBlockAllocator, TestCheckIndex, TestTermVectorsReader, TestCharFilter, TestLucene50FieldInfoFormat, TestSortedSetSelector, TestPostingsOffsets, TestBagOfPositions, TestIndexReaderClose, TestConjunctionDISI, TestSpanExplanations, TestPositiveScoresOnlyCollector, TestTwoPhaseCommitTool, TestIntArrayDocIdSet, TestWildcard, TestSpanNearQuery, TestStressDeletes, TestQueryWrapperFilter, TestExternalCodecs, TestSparseFixedBitSet, TestIndexWriterLockRelease, TestFilterIterator, TestNumericTokenStream, FuzzyTermOnShortTermsTest, TestNativeFSLockFactory, TestSortRandom, TestDocCount, TestTerms, TestConjunctions, TestSubScorerFreqs, TestLongPostings, TestSearchForDuplicates, TestCharsRef, TestFieldValueQuery, TestQueryBuilder, TestMultiMMap, TestDoc, TestField, TestBytesStore, TestQueryRescorer, TestFastDecompressionMode, TestSloppyPhraseQuery2, TestMixedDocValuesUpdates, TestBooleanMinShouldMatch, TestTieredMergePolicy, TestForTooMuchCloning, TestSumDocFreq, TestPayloadExplanations, TestBufferedIndexInput, TestLucene50DocValuesFormat, TestFastCompressionMode, TestCodecUtil, TestSameTokenSamePosition, TestDemoParallelLeafReader, TestConsistentFieldNumbers, TestRegexpRandom2, TestAllFilesHaveCodecHeader, Test2BTerms, TestReadOnlyIndex, TestNRTReaderCleanup, TestMmapDirectory, TestLucene53NormsFormat, TestSimpleSearchEquivalence, TestSimilarityBase, TestHugeRamFile, TestRAMDirectory, TestTermVectorsWriter, TestOmitPositions, TestBytesRefHash, TestForceMergeForever, TestOmitTf, TestNearSpansOrdered, TestDocumentsWriterDeleteQueue, TestDocumentWriter, TestCrashCausesCorruptIndex, TestScorerPerf, TestNamedSPILoader, TestAssertions, Test4GBStoredFields, TestNGramPhraseQuery, TestTermdocPerf, TestNewestSegment, TestBlockPostingsFormat, TestIndexWriterFromReader, TestIndexWriterMaxDocs, TestIndexWriterOutOfFileDescriptors]
   [junit4] Completed [352/401] on J2 in 2.62s, 1 test, 1 error <<< FAILURES!

[...truncated 164 lines...]
BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:716: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:660: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/build.xml:59: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/build.xml:50: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:1429: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-trunk-Linux/lucene/common-build.xml:984: There were test failures: 401 suites, 3225 tests, 1 error, 51 ignored (47 assumptions)

Total time: 4 minutes 53 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any