You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/01/10 10:39:32 UTC

[JENKINS] Lucene-Solr-master-Windows (64bit/jdk1.8.0_112) - Build # 6348 - Still Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Windows/6348/
Java: 64bit/jdk1.8.0_112 -XX:-UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Captured an uncaught exception in thread: Thread[id=1733, name=SocketProxy-Response-62434:62720, state=RUNNABLE, group=TGRP-HttpPartitionTest]

Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1733, name=SocketProxy-Response-62434:62720, state=RUNNABLE, group=TGRP-HttpPartitionTest]
	at __randomizedtesting.SeedInfo.seed([834455F2095F62BD:B106A28A7A30F45]:0)
Caused by: java.lang.RuntimeException: java.net.SocketException: Socket is closed
	at __randomizedtesting.SeedInfo.seed([834455F2095F62BD]:0)
	at org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:347)
Caused by: java.net.SocketException: Socket is closed
	at java.net.Socket.setSoTimeout(Socket.java:1137)
	at org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:344)




Build Log:
[...truncated 10858 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> Creating dataDir: C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\init-core-data-001
   [junit4]   2> 195671 INFO  (SUITE-HttpPartitionTest-seed#[834455F2095F62BD]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 195671 INFO  (SUITE-HttpPartitionTest-seed#[834455F2095F62BD]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 195675 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 195678 INFO  (Thread-286) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 195678 INFO  (Thread-286) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 195777 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.ZkTestServer start zk server on port:62394
   [junit4]   2> 195811 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 195815 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 195818 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 195820 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 195822 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 195825 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 195828 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 195831 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 195833 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 195836 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 195838 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractZkTestCase put C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\core\src\test-files\solr\collection1\conf\synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 196506 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\control-001\cores\collection1
   [junit4]   2> 196511 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 196512 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@22a01bc6{/,null,AVAILABLE}
   [junit4]   2> 196515 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@20329bda{HTTP/1.1,[http/1.1]}{127.0.0.1:62402}
   [junit4]   2> 196515 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.Server Started @203282ms
   [junit4]   2> 196515 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\tempDir-001/control/data, hostContext=/, hostPort=62401, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\control-001\cores}
   [junit4]   2> 196515 ERROR (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 196516 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 196516 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 196516 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 196516 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-10T09:26:11.277Z
   [junit4]   2> 196521 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15987b2f90e0002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 196521 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 196521 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\control-001\solr.xml
   [junit4]   2> 196540 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62394/solr
   [junit4]   2> 196544 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15987b2f90e0003, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 196575 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62401_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:62401_
   [junit4]   2> 196577 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62401_    ] o.a.s.c.Overseer Overseer (id=97258069717549060-127.0.0.1:62401_-n_0000000000) starting
   [junit4]   2> 196588 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62401_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62401_
   [junit4]   2> 196594 INFO  (OverseerStateUpdate-97258069717549060-127.0.0.1:62401_-n_0000000000) [n:127.0.0.1:62401_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 196652 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62401_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\control-001\cores
   [junit4]   2> 196652 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62401_    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 196679 INFO  (OverseerStateUpdate-97258069717549060-127.0.0.1:62401_-n_0000000000) [n:127.0.0.1:62401_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 196702 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 196719 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 196896 WARN  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 196900 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 196936 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection control_collection
   [junit4]   2> 196936 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\control-001\cores\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\control-001\cores\collection1\data\]
   [junit4]   2> 196936 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d4e5c5
   [junit4]   2> 196938 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=27.59375, floorSegmentMB=1.880859375, forceMergeDeletesPctAllowed=16.716415388673372, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.21711580525818777
   [junit4]   2> 196947 WARN  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 196972 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 196972 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 196974 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 196974 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 196975 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.30180637614508055]
   [junit4]   2> 196978 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@486a0b3a[collection1] main]
   [junit4]   2> 196979 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 196981 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 196981 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 196981 INFO  (coreLoadExecutor-457-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1556129116839739392
   [junit4]   2> 196987 INFO  (searcherExecutor-458-thread-1-processing-n:127.0.0.1:62401_ x:collection1 c:control_collection) [n:127.0.0.1:62401_ c:control_collection   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@486a0b3a[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 196995 INFO  (coreZkRegister-450-thread-1-processing-n:127.0.0.1:62401_ x:collection1 c:control_collection) [n:127.0.0.1:62401_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 196995 INFO  (coreZkRegister-450-thread-1-processing-n:127.0.0.1:62401_ x:collection1 c:control_collection) [n:127.0.0.1:62401_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 196995 INFO  (coreZkRegister-450-thread-1-processing-n:127.0.0.1:62401_ x:collection1 c:control_collection) [n:127.0.0.1:62401_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:62401/collection1/
   [junit4]   2> 196995 INFO  (coreZkRegister-450-thread-1-processing-n:127.0.0.1:62401_ x:collection1 c:control_collection) [n:127.0.0.1:62401_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 196995 INFO  (coreZkRegister-450-thread-1-processing-n:127.0.0.1:62401_ x:collection1 c:control_collection) [n:127.0.0.1:62401_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:62401/collection1/ has no replicas
   [junit4]   2> 197001 INFO  (coreZkRegister-450-thread-1-processing-n:127.0.0.1:62401_ x:collection1 c:control_collection) [n:127.0.0.1:62401_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:62401/collection1/ shard1
   [junit4]   2> 197129 INFO  (coreZkRegister-450-thread-1-processing-n:127.0.0.1:62401_ x:collection1 c:control_collection) [n:127.0.0.1:62401_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 197185 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 197187 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:62394/solr ready
   [junit4]   2> 197187 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 197187 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection1 with stateFormat=2
   [junit4]   2> 197752 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-1-001\cores\collection1
   [junit4]   2> 197755 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-1-001
   [junit4]   2> 197755 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 197757 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7c9902d7{/,null,AVAILABLE}
   [junit4]   2> 197759 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4bfe66cb{HTTP/1.1,[http/1.1]}{127.0.0.1:62421}
   [junit4]   2> 197759 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.Server Started @204526ms
   [junit4]   2> 197759 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=62420, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-1-001\cores}
   [junit4]   2> 197759 ERROR (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 197759 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 197759 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 197759 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 197759 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-10T09:26:12.520Z
   [junit4]   2> 197766 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 197766 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-1-001\solr.xml
   [junit4]   2> 197787 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62394/solr
   [junit4]   2> 197818 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 197823 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62420_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62420_
   [junit4]   2> 197830 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 197831 INFO  (zkCallback-322-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 197830 INFO  (zkCallback-326-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 197968 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62420_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-1-001\cores
   [junit4]   2> 197968 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62420_    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 198031 INFO  (OverseerStateUpdate-97258069717549060-127.0.0.1:62401_-n_0000000000) [n:127.0.0.1:62401_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 198151 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 199053 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 199070 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 199186 WARN  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 199189 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 199224 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 199224 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-1-001\cores\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-1-001\cores\collection1\data\]
   [junit4]   2> 199224 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d4e5c5
   [junit4]   2> 199229 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=27.59375, floorSegmentMB=1.880859375, forceMergeDeletesPctAllowed=16.716415388673372, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.21711580525818777
   [junit4]   2> 199235 WARN  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 199257 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 199257 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 199260 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 199260 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 199261 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.30180637614508055]
   [junit4]   2> 199262 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1a9d1eb2[collection1] main]
   [junit4]   2> 199264 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 199265 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 199265 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 199287 INFO  (searcherExecutor-469-thread-1-processing-n:127.0.0.1:62420_ x:collection1 c:collection1) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@1a9d1eb2[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 199288 INFO  (coreLoadExecutor-468-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_ c:collection1   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1556129119258804224
   [junit4]   2> 199299 INFO  (coreZkRegister-463-thread-1-processing-n:127.0.0.1:62420_ x:collection1 c:collection1) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 199299 INFO  (coreZkRegister-463-thread-1-processing-n:127.0.0.1:62420_ x:collection1 c:collection1) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 199299 INFO  (coreZkRegister-463-thread-1-processing-n:127.0.0.1:62420_ x:collection1 c:collection1) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:62420/collection1/
   [junit4]   2> 199299 INFO  (coreZkRegister-463-thread-1-processing-n:127.0.0.1:62420_ x:collection1 c:collection1) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 199299 INFO  (coreZkRegister-463-thread-1-processing-n:127.0.0.1:62420_ x:collection1 c:collection1) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:62420/collection1/ has no replicas
   [junit4]   2> 199309 INFO  (coreZkRegister-463-thread-1-processing-n:127.0.0.1:62420_ x:collection1 c:collection1) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:62420/collection1/ shard2
   [junit4]   2> 199425 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 199504 INFO  (coreZkRegister-463-thread-1-processing-n:127.0.0.1:62420_ x:collection1 c:collection1) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 199961 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 200403 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-2-001\cores\collection1
   [junit4]   2> 200407 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-2-001
   [junit4]   2> 200408 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 200409 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7769baee{/,null,AVAILABLE}
   [junit4]   2> 200410 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@10373fe7{HTTP/1.1,[http/1.1]}{127.0.0.1:62434}
   [junit4]   2> 200411 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.Server Started @207178ms
   [junit4]   2> 200411 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\tempDir-001/jetty2, solrconfig=solrconfig.xml, hostContext=/, hostPort=62433, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-2-001\cores}
   [junit4]   2> 200411 ERROR (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 200418 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 200418 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 200418 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 200421 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-10T09:26:15.179Z
   [junit4]   2> 200435 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 200435 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-2-001\solr.xml
   [junit4]   2> 200455 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62394/solr
   [junit4]   2> 200459 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15987b2f90e000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 200471 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62433_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 200479 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62433_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62433_
   [junit4]   2> 200482 INFO  (zkCallback-326-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 200485 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 200485 INFO  (zkCallback-322-thread-3-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 200485 INFO  (zkCallback-338-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 200538 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62433_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-2-001\cores
   [junit4]   2> 200538 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62433_    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 200555 INFO  (OverseerStateUpdate-97258069717549060-127.0.0.1:62401_-n_0000000000) [n:127.0.0.1:62401_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard1
   [junit4]   2> 200661 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 200661 INFO  (zkCallback-338-thread-2-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 201600 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 201616 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 201735 WARN  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 201738 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 201773 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 201773 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-2-001\cores\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-2-001\cores\collection1\data\]
   [junit4]   2> 201774 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d4e5c5
   [junit4]   2> 201777 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=27.59375, floorSegmentMB=1.880859375, forceMergeDeletesPctAllowed=16.716415388673372, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.21711580525818777
   [junit4]   2> 201781 WARN  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 201808 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 201808 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 201810 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 201810 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 201815 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.30180637614508055]
   [junit4]   2> 201816 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7ea648b6[collection1] main]
   [junit4]   2> 201818 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 201819 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 201819 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 201821 INFO  (searcherExecutor-480-thread-1-processing-n:127.0.0.1:62433_ x:collection1 c:collection1) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7ea648b6[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 201821 INFO  (coreLoadExecutor-479-thread-1-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_ c:collection1   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1556129121914847232
   [junit4]   2> 201834 INFO  (coreZkRegister-474-thread-1-processing-n:127.0.0.1:62433_ x:collection1 c:collection1) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 201834 INFO  (coreZkRegister-474-thread-1-processing-n:127.0.0.1:62433_ x:collection1 c:collection1) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 201834 INFO  (coreZkRegister-474-thread-1-processing-n:127.0.0.1:62433_ x:collection1 c:collection1) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:62433/collection1/
   [junit4]   2> 201834 INFO  (coreZkRegister-474-thread-1-processing-n:127.0.0.1:62433_ x:collection1 c:collection1) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 201834 INFO  (coreZkRegister-474-thread-1-processing-n:127.0.0.1:62433_ x:collection1 c:collection1) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.SyncStrategy http://127.0.0.1:62433/collection1/ has no replicas
   [junit4]   2> 201838 INFO  (coreZkRegister-474-thread-1-processing-n:127.0.0.1:62433_ x:collection1 c:collection1) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:62433/collection1/ shard1
   [junit4]   2> 201943 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 201944 INFO  (zkCallback-338-thread-2-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 201992 INFO  (coreZkRegister-474-thread-1-processing-n:127.0.0.1:62433_ x:collection1 c:collection1) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 202101 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 202103 INFO  (zkCallback-338-thread-2-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 202665 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-3-001\cores\collection1
   [junit4]   2> 202667 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-3-001
   [junit4]   2> 202668 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.Server jetty-9.3.14.v20161028
   [junit4]   2> 202669 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@678b4171{/,null,AVAILABLE}
   [junit4]   2> 202670 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@73cd8856{HTTP/1.1,[http/1.1]}{127.0.0.1:62447}
   [junit4]   2> 202670 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.Server Started @209438ms
   [junit4]   2> 202670 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/, hostPort=62446, coreRootDirectory=C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-3-001\cores}
   [junit4]   2> 202671 ERROR (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 202671 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 7.0.0
   [junit4]   2> 202671 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 202671 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 202671 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-01-10T09:26:17.432Z
   [junit4]   2> 202678 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 202678 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-3-001\solr.xml
   [junit4]   2> 202698 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62394/solr
   [junit4]   2> 202701 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15987b2f90e000e, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:228)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:745)
   [junit4]   2> 202714 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62446_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 202720 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62446_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62446_
   [junit4]   2> 202749 INFO  (zkCallback-326-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 202749 INFO  (zkCallback-322-thread-3-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 202749 INFO  (zkCallback-338-thread-2-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 202749 INFO  (zkCallback-344-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 202750 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 202766 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62446_    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-3-001\cores
   [junit4]   2> 202766 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [n:127.0.0.1:62446_    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 202832 INFO  (OverseerStateUpdate-97258069717549060-127.0.0.1:62401_-n_0000000000) [n:127.0.0.1:62401_    ] o.a.s.c.o.ReplicaMutator Assigning new node to shard shard=shard2
   [junit4]   2> 202937 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 202937 INFO  (zkCallback-338-thread-2-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 202937 INFO  (zkCallback-344-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 203858 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 203875 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 204010 WARN  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.s.IndexSchema [collection1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 204013 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 204042 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from collection collection1
   [junit4]   2> 204043 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-3-001\cores\collection1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-3-001\cores\collection1\data\]
   [junit4]   2> 204044 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d4e5c5
   [junit4]   2> 204046 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=27.59375, floorSegmentMB=1.880859375, forceMergeDeletesPctAllowed=16.716415388673372, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.21711580525818777
   [junit4]   2> 204054 WARN  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 204089 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 204089 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 204091 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 204091 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 204092 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.30180637614508055]
   [junit4]   2> 204094 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@47696c91[collection1] main]
   [junit4]   2> 204096 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 204096 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 204097 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 204097 INFO  (searcherExecutor-491-thread-1-processing-n:127.0.0.1:62446_ x:collection1 c:collection1) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@47696c91[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 204097 INFO  (coreLoadExecutor-490-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1   x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1556129124301406208
   [junit4]   2> 204104 INFO  (coreZkRegister-485-thread-1-processing-n:127.0.0.1:62446_ x:collection1 c:collection1) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.ZkController Core needs to recover:collection1
   [junit4]   2> 204105 INFO  (updateExecutor-341-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 204106 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 204106 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 204106 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1]
   [junit4]   2> 204106 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 204106 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1] as recovering, leader is [http://127.0.0.1:62420/collection1/] and I am [http://127.0.0.1:62446/collection1/]
   [junit4]   2> 204110 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:62420]; [WaitForState: action=PREPRECOVERY&core=collection1&nodeName=127.0.0.1:62446_&coreNodeName=core_node3&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 204112 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62459,localport=62420], receiveBufferSize:65536
   [junit4]   2> 204115 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62421,localport=62460], receiveBufferSize=65536
   [junit4]   2> 204213 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 204214 INFO  (zkCallback-338-thread-2-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 204214 INFO  (zkCallback-344-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 204324 INFO  (qtp1032336117-1443) [n:127.0.0.1:62420_    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true
   [junit4]   2> 204325 INFO  (qtp1032336117-1443) [n:127.0.0.1:62420_    ] o.a.s.h.a.PrepRecoveryOp Will wait a max of 183 seconds to see collection1 (shard2 of collection1) have state: recovering
   [junit4]   2> 204325 INFO  (qtp1032336117-1443) [n:127.0.0.1:62420_    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:62446_, coreNodeName=core_node3, onlyIfActiveCheckResult=false, nodeProps: core_node3:{"core":"collection1","base_url":"http://127.0.0.1:62446","node_name":"127.0.0.1:62446_","state":"recovering"}
   [junit4]   2> 204325 INFO  (qtp1032336117-1443) [n:127.0.0.1:62420_    ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node3, state: recovering, checkLive: true, onlyIfLeader: true for: 0 seconds.
   [junit4]   2> 204325 INFO  (qtp1032336117-1443) [n:127.0.0.1:62420_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:62446_&onlyIfLeaderActive=true&core=collection1&coreNodeName=core_node3&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 204335 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 204335 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Wait for recoveries to finish - wait 30000 for each attempt
   [junit4]   2> 204336 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30000
   [junit4]   2> 211338 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Attempting to PeerSync from [http://127.0.0.1:62420/collection1/] - recoveringAfterStartup=[true]
   [junit4]   2> 211338 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.PeerSync PeerSync: core=collection1 url=http://127.0.0.1:62446 START replicas=[http://127.0.0.1:62420/collection1/] nUpdates=100
   [junit4]   2> 211342 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62479,localport=62420], receiveBufferSize:65536
   [junit4]   2> 211342 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62421,localport=62480], receiveBufferSize=65536
   [junit4]   2> 211354 INFO  (qtp1032336117-1439) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.IndexFingerprint IndexFingerprint millis:4.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
   [junit4]   2> 211354 INFO  (qtp1032336117-1439) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/get params={distrib=false&qt=/get&getFingerprint=9223372036854775807&wt=javabin&version=2} status=0 QTime=4
   [junit4]   2> 211356 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.IndexFingerprint IndexFingerprint millis:1.0 result:{maxVersionSpecified=9223372036854775807, maxVersionEncountered=0, maxInHash=0, versionsHash=0, numVersions=0, numDocs=0, maxDoc=0}
   [junit4]   2> 211356 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.PeerSync We are already in sync. No need to do a PeerSync 
   [junit4]   2> 211356 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 211356 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 211356 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 211357 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy PeerSync stage of recovery was successful.
   [junit4]   2> 211357 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Replaying updates buffered during PeerSync.
   [junit4]   2> 211357 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy No replay needed.
   [junit4]   2> 211357 INFO  (recoveryExecutor-342-thread-1-processing-n:127.0.0.1:62446_ x:collection1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.RecoveryStrategy Registering as Active after recovery.
   [junit4]   2> 211361 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 211361 INFO  (zkCallback-344-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 211362 INFO  (zkCallback-338-thread-2-processing-n:127.0.0.1:62433_) [n:127.0.0.1:62433_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 212357 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1
   [junit4]   2> 212359 INFO  (SocketProxy-Acceptor-62401) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62481,localport=62401], receiveBufferSize:65536
   [junit4]   2> 212359 INFO  (SocketProxy-Acceptor-62401) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62402,localport=62482], receiveBufferSize=65536
   [junit4]   2> 212364 INFO  (qtp1454850658-1396) [n:127.0.0.1:62401_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 212365 INFO  (qtp1454850658-1396) [n:127.0.0.1:62401_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 212366 INFO  (qtp1454850658-1396) [n:127.0.0.1:62401_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 212366 INFO  (qtp1454850658-1396) [n:127.0.0.1:62401_ c:control_collection s:shard1 r:core_node1 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 1
   [junit4]   2> 212368 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62483,localport=62420], receiveBufferSize:65536
   [junit4]   2> 212368 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62421,localport=62484], receiveBufferSize=65536
   [junit4]   2> 212373 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62485,localport=62420], receiveBufferSize:65536
   [junit4]   2> 212374 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62421,localport=62486], receiveBufferSize=65536
   [junit4]   2> 212380 INFO  (SocketProxy-Acceptor-62433) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62487,localport=62433], receiveBufferSize:65536
   [junit4]   2> 212380 INFO  (SocketProxy-Acceptor-62433) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62434,localport=62488], receiveBufferSize=65536
   [junit4]   2> 212382 INFO  (SocketProxy-Acceptor-62446) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62489,localport=62446], receiveBufferSize:65536
   [junit4]   2> 212382 INFO  (SocketProxy-Acceptor-62446) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62447,localport=62490], receiveBufferSize=65536
   [junit4]   2> 212397 INFO  (qtp1032336117-1437) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 212397 INFO  (qtp1032336117-1437) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 212399 INFO  (qtp1459847250-1472) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 212399 INFO  (qtp1875797516-1498) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 212400 INFO  (qtp1459847250-1472) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 212400 INFO  (qtp1032336117-1437) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 212401 INFO  (qtp1032336117-1437) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:62420/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 4
   [junit4]   2> 212402 INFO  (qtp1875797516-1498) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 212402 INFO  (qtp1875797516-1498) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 212403 INFO  (qtp1875797516-1498) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:62420/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 3
   [junit4]   2> 212406 INFO  (qtp1459847250-1472) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 212407 INFO  (qtp1459847250-1472) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:62420/collection1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 8
   [junit4]   2> 212409 INFO  (qtp1032336117-1442) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={_stateVer_=collection1:10&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 38
   [junit4]   2> 212412 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62491,localport=62420], receiveBufferSize:65536
   [junit4]   2> 212412 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62421,localport=62492], receiveBufferSize=65536
   [junit4]   2> 212418 INFO  (qtp1032336117-1443) [n:127.0.0.1:62420_ c:collection1 s:shard2 r:core_node1 x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 212420 INFO  (SocketProxy-Acceptor-62446) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62493,localport=62446], receiveBufferSize:65536
   [junit4]   2> 212421 INFO  (SocketProxy-Acceptor-62446) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62447,localport=62494], receiveBufferSize=65536
   [junit4]   2> 212424 INFO  (qtp1875797516-1508) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 212427 INFO  (SocketProxy-Acceptor-62433) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62495,localport=62433], receiveBufferSize:65536
   [junit4]   2> 212427 INFO  (SocketProxy-Acceptor-62433) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62434,localport=62496], receiveBufferSize=65536
   [junit4]   2> 212430 INFO  (qtp1459847250-1468) [n:127.0.0.1:62433_ c:collection1 s:shard1 r:core_node2 x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&tests=checkShardConsistency&rows=0&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 214436 INFO  (SocketProxy-Acceptor-62433) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62497,localport=62433], receiveBufferSize:65536
   [junit4]   2> 214437 INFO  (SocketProxy-Acceptor-62433) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62434,localport=62498], receiveBufferSize=65536
   [junit4]   2> 214441 INFO  (qtp1459847250-1465) [n:127.0.0.1:62433_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&maxShardsPerNode=1&name=c8n_crud_1x2&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 214445 INFO  (OverseerThreadFactory-455-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_    ] o.a.s.c.CreateCollectionCmd Create collection c8n_crud_1x2
   [junit4]   2> 214446 INFO  (OverseerThreadFactory-455-thread-1-processing-n:127.0.0.1:62401_) [n:127.0.0.1:62401_    ] o.a.s.c.CreateCollectionCmd Only one config set found in zk - using it:conf1
   [junit4]   2> 214556 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62499,localport=62420], receiveBufferSize:65536
   [junit4]   2> 214556 INFO  (SocketProxy-Acceptor-62446) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=62500,localport=62446], receiveBufferSize:65536
   [junit4]   2> 214557 INFO  (SocketProxy-Acceptor-62420) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62421,localport=62501], receiveBufferSize=65536
   [junit4]   2> 214557 INFO  (SocketProxy-Acceptor-62446) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=62447,localport=62502], receiveBufferSize=65536
   [junit4]   2> 214561 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=c8n_crud_1x2_shard1_replica2&action=CREATE&numShards=1&collection=c8n_crud_1x2&shard=shard1&wt=javabin&version=2
   [junit4]   2> 214564 INFO  (qtp1032336117-1439) [n:127.0.0.1:62420_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=c8n_crud_1x2_shard1_replica1&action=CREATE&numShards=1&collection=c8n_crud_1x2&shard=shard1&wt=javabin&version=2
   [junit4]   2> 214680 INFO  (zkCallback-332-thread-1-processing-n:127.0.0.1:62420_) [n:127.0.0.1:62420_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 214680 INFO  (zkCallback-344-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/c8n_crud_1x2/state.json] for collection [c8n_crud_1x2] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 215637 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 215673 INFO  (qtp1032336117-1439) [n:127.0.0.1:62420_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.0.0
   [junit4]   2> 215692 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.s.IndexSchema [c8n_crud_1x2_shard1_replica2] Schema name=test
   [junit4]   2> 215793 INFO  (qtp1032336117-1439) [n:127.0.0.1:62420_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica1] o.a.s.s.IndexSchema [c8n_crud_1x2_shard1_replica1] Schema name=test
   [junit4]   2> 215895 WARN  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.s.IndexSchema [c8n_crud_1x2_shard1_replica2] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 215897 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 215907 WARN  (qtp1032336117-1439) [n:127.0.0.1:62420_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica1] o.a.s.s.IndexSchema [c8n_crud_1x2_shard1_replica1] default search field in schema is text. WARNING: Deprecated, please use 'df' on request instead.
   [junit4]   2> 215910 INFO  (qtp1032336117-1439) [n:127.0.0.1:62420_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 215919 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.c.CoreContainer Creating SolrCore 'c8n_crud_1x2_shard1_replica2' using configuration from collection c8n_crud_1x2
   [junit4]   2> 215920 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.c.SolrCore [[c8n_crud_1x2_shard1_replica2] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-3-001\cores\c8n_crud_1x2_shard1_replica2], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-3-001\cores\c8n_crud_1x2_shard1_replica2\data\]
   [junit4]   2> 215920 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d4e5c5
   [junit4]   2> 215929 INFO  (qtp1032336117-1439) [n:127.0.0.1:62420_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica1] o.a.s.c.CoreContainer Creating SolrCore 'c8n_crud_1x2_shard1_replica1' using configuration from collection c8n_crud_1x2
   [junit4]   2> 215959 INFO  (qtp1032336117-1439) [n:127.0.0.1:62420_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica1] o.a.s.c.SolrCore [[c8n_crud_1x2_shard1_replica1] ] Opening new SolrCore at [C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-1-001\cores\c8n_crud_1x2_shard1_replica1], dataDir=[C:\Users\jenkins\workspace\Lucene-Solr-master-Windows\solr\build\solr-core\test\J0\temp\solr.cloud.HttpPartitionTest_834455F2095F62BD-001\shard-1-001\cores\c8n_crud_1x2_shard1_replica1\data\]
   [junit4]   2> 215960 INFO  (qtp1032336117-1439) [n:127.0.0.1:62420_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica1] o.a.s.c.JmxMonitoredMap JMX monitoring is enabled. Adding Solr mbeans to JMX Server: com.sun.jmx.mbeanserver.JmxMBeanServer@26d4e5c5
   [junit4]   2> 215963 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=27.59375, floorSegmentMB=1.880859375, forceMergeDeletesPctAllowed=16.716415388673372, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.21711580525818777
   [junit4]   2> 215965 INFO  (qtp1032336117-1439) [n:127.0.0.1:62420_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=25, maxMergedSegmentMB=27.59375, floorSegmentMB=1.880859375, forceMergeDeletesPctAllowed=16.716415388673372, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.21711580525818777
   [junit4]   2> 215982 WARN  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 216084 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 216084 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 216087 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 216087 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 216088 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=20, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.30180637614508055]
   [junit4]   2> 216089 INFO  (qtp1875797516-1503) [n:127.0.0.1:62446_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica2] o.a.s.s.SolrIndexSearcher Opening [Searcher@52f5bb00[c8n_crud_1x2_shard1_replica2] main]
   [junit4]   2> 216093 WARN  (qtp1032336117-1439) [n:127.0.0.1:62420_ c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica1] o.a.s.c.RequestHandlers INVALID paramSet a i

[...truncated too long message...]

o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 321071 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@10373fe7{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 321071 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7769baee{/,null,UNAVAILABLE}
   [junit4]   2> 321076 INFO  (zkCallback-344-thread-3-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:62446_
   [junit4]   2> 321076 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.ChaosMonkey monkey: stop shard! 62446
   [junit4]   2> 321076 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1281848200
   [junit4]   2> 321078 INFO  (zkCallback-344-thread-3-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_    ] o.a.s.c.Overseer Overseer (id=97258069717549071-127.0.0.1:62446_-n_0000000003) starting
   [junit4]   2> 321080 INFO  (coreCloseExecutor-573-thread-2) [n:127.0.0.1:62446_ c:collMinRf_1x3 s:shard1 r:core_node2 x:collMinRf_1x3_shard1_replica2] o.a.s.c.SolrCore [collMinRf_1x3_shard1_replica2]  CLOSING SolrCore org.apache.solr.core.SolrCore@365a0938
   [junit4]   2> 321093 INFO  (zkCallback-344-thread-3-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 321094 INFO  (zkCallback-344-thread-3-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 321103 INFO  (zkCallback-344-thread-2-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collMinRf_1x3/state.json] for collection [collMinRf_1x3] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 321108 INFO  (coreCloseExecutor-573-thread-2) [n:127.0.0.1:62446_ c:collMinRf_1x3 s:shard1 r:core_node2 x:collMinRf_1x3_shard1_replica2] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collMinRf_1x3.shard1.replica2
   [junit4]   2> 321111 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.Overseer Overseer (id=97258069717549071-127.0.0.1:62446_-n_0000000003) closing
   [junit4]   2> 321112 INFO  (OverseerStateUpdate-97258069717549071-127.0.0.1:62446_-n_0000000003) [n:127.0.0.1:62446_    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:62446_
   [junit4]   2> 321113 INFO  (zkCallback-326-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 322613 WARN  (zkCallback-344-thread-2-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 323517 WARN  (zkCallback-344-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.SyncStrategy Closed, skipping sync up.
   [junit4]   2> 323517 INFO  (zkCallback-344-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 323517 INFO  (zkCallback-344-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.c.SolrCore [collection1]  CLOSING SolrCore org.apache.solr.core.SolrCore@419f889e
   [junit4]   2> 323529 INFO  (zkCallback-344-thread-1-processing-n:127.0.0.1:62446_) [n:127.0.0.1:62446_ c:collection1 s:shard2 r:core_node3 x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.core.collection1
   [junit4]   2> 323530 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for: solr.node
   [junit4]   2> 323534 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@73cd8856{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 323534 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@678b4171{/,null,UNAVAILABLE}
   [junit4]   2> 323539 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.ChaosMonkey monkey: stop shard! 62401
   [junit4]   2> 323540 INFO  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:62394 62394
   [junit4]   2> 323541 INFO  (Thread-286) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:62394 62394
   [junit4]   2> 323543 WARN  (Thread-286) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 	2	/solr/collections/control_collection/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	4	/solr/collections/collMinRf_1x3/state.json
   [junit4]   2> 	3	/solr/collections/collection1/state.json
   [junit4]   2> 	3	/solr/collections/c8n_1x3/state.json
   [junit4]   2> 	3	/solr/collections/c8n_1x2_leader_session_loss/state.json
   [junit4]   2> 	2	/solr/collections/c8n_1x2/state.json
   [junit4]   2> 	2	/solr/overseer_elect/election/97258069717549071-127.0.0.1:62446_-n_0000000003
   [junit4]   2> 	2	/solr/collections/c8n_crud_1x2/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	143	/solr/overseer/queue
   [junit4]   2> 	104	/solr/overseer/collection-queue-work
   [junit4]   2> 	35	/solr/overseer/queue-work
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	5	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 323545 WARN  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.SocketProxy Closing 19 connections to: http://127.0.0.1:62446/, target: http://127.0.0.1:62447/
   [junit4]   2> 323545 WARN  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.SocketProxy Closing 6 connections to: http://127.0.0.1:62420/, target: http://127.0.0.1:62421/
   [junit4]   2> 323545 WARN  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.SocketProxy Closing 7 connections to: http://127.0.0.1:62401/, target: http://127.0.0.1:62402/
   [junit4]   2> 323546 WARN  (TEST-HttpPartitionTest.test-seed#[834455F2095F62BD]) [    ] o.a.s.c.SocketProxy Closing 17 connections to: http://127.0.0.1:62433/, target: http://127.0.0.1:62434/
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpPartitionTest -Dtests.method=test -Dtests.seed=834455F2095F62BD -Dtests.slow=true -Dtests.locale=ar-LB -Dtests.timezone=EET -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] ERROR    128s J0 | HttpPartitionTest.test <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=1733, name=SocketProxy-Response-62434:62720, state=RUNNABLE, group=TGRP-HttpPartitionTest]
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([834455F2095F62BD:B106A28A7A30F45]:0)
   [junit4]    > Caused by: java.lang.RuntimeException: java.net.SocketException: Socket is closed
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([834455F2095F62BD]:0)
   [junit4]    > 	at org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:347)
   [junit4]    > Caused by: java.net.SocketException: Socket is closed
   [junit4]    > 	at java.net.Socket.setSoTimeout(Socket.java:1137)
   [junit4]    > 	at org.apache.solr.cloud.SocketProxy$Bridge$Pump.run(SocketProxy.java:344)
   [junit4]   2> 323550 INFO  (SUITE-HttpPartitionTest-seed#[834455F2095F62BD]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {range_facet_l_dv=Lucene50(blocksize=128), _version_=FSTOrd50, multiDefault=PostingsFormat(name=Direct), a_t=FSTOrd50, intDefault=FSTOrd50, id=Lucene50(blocksize=128), range_facet_i_dv=FSTOrd50, text=Lucene50(blocksize=128), range_facet_l=FSTOrd50, timestamp=FSTOrd50}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1333, maxMBSortInHeap=7.759685635832025, sim=RandomSimilarity(queryNorm=false): {}, locale=ar-LB, timezone=EET
   [junit4]   2> NOTE: Windows 10 10.0 amd64/Oracle Corporation 1.8.0_112 (64-bit)/cpus=3,threads=1,free=137214648,total=406847488
   [junit4]   2> NOTE: All tests run in this JVM: [HdfsSyncSliceTest, DistanceUnitsTest, OverseerTest, TlogReplayBufferedWhileIndexingTest, HdfsDirectoryTest, DistributedQueueTest, DirectUpdateHandlerTest, TestCustomStream, SyncSliceTest, ReplicaListTransformerTest, CopyFieldTest, TestPseudoReturnFields, TestLRUStatsCache, TestXmlQParser, HttpPartitionTest]
   [junit4] Completed [47/677 (1!)] on J0 in 128.64s, 1 test, 1 error <<< FAILURES!

[...truncated 64502 lines...]