You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/08/21 14:40:54 UTC

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20354 - Unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20354/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth:     1) Thread[id=21925, name=jetty-launcher-2664-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)    2) Thread[id=21929, name=jetty-launcher-2664-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 
   1) Thread[id=21925, name=jetty-launcher-2664-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   2) Thread[id=21929, name=jetty-launcher-2664-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
	at __randomizedtesting.SeedInfo.seed([8983C477E607B9CC]:0)




Build Log:
[...truncated 13188 lines...]
   [junit4] Suite: org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_8983C477E607B9CC-001/init-core-data-001
   [junit4]   2> 2362316 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[8983C477E607B9CC]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2362317 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[8983C477E607B9CC]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 2362317 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[8983C477E607B9CC]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2362329 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[8983C477E607B9CC]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_8983C477E607B9CC-001/tempDir-001
   [junit4]   2> 2362329 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[8983C477E607B9CC]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2362329 INFO  (Thread-8488) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2362329 INFO  (Thread-8488) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2362330 ERROR (Thread-8488) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2362429 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[8983C477E607B9CC]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:33783
   [junit4]   2> 2362437 INFO  (jetty-launcher-2664-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2362437 INFO  (jetty-launcher-2664-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2362438 INFO  (jetty-launcher-2664-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7ca4c1b5{/solr,null,AVAILABLE}
   [junit4]   2> 2362438 INFO  (jetty-launcher-2664-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@453203b7{/solr,null,AVAILABLE}
   [junit4]   2> 2362440 INFO  (jetty-launcher-2664-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@54851cea{HTTP/1.1,[http/1.1]}{127.0.0.1:45985}
   [junit4]   2> 2362440 INFO  (jetty-launcher-2664-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2bf0f6fd{HTTP/1.1,[http/1.1]}{127.0.0.1:45243}
   [junit4]   2> 2362440 INFO  (jetty-launcher-2664-thread-1) [    ] o.e.j.s.Server Started @2364042ms
   [junit4]   2> 2362440 INFO  (jetty-launcher-2664-thread-2) [    ] o.e.j.s.Server Started @2364042ms
   [junit4]   2> 2362440 INFO  (jetty-launcher-2664-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45985}
   [junit4]   2> 2362440 INFO  (jetty-launcher-2664-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45243}
   [junit4]   2> 2362440 ERROR (jetty-launcher-2664-thread-1) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2362440 ERROR (jetty-launcher-2664-thread-2) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2362441 INFO  (jetty-launcher-2664-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2362441 INFO  (jetty-launcher-2664-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2362441 INFO  (jetty-launcher-2664-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2362441 INFO  (jetty-launcher-2664-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2362441 INFO  (jetty-launcher-2664-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2362441 INFO  (jetty-launcher-2664-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2362441 INFO  (jetty-launcher-2664-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-21T14:27:16.069Z
   [junit4]   2> 2362441 INFO  (jetty-launcher-2664-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-21T14:27:16.069Z
   [junit4]   2> 2362443 INFO  (jetty-launcher-2664-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2362443 INFO  (jetty-launcher-2664-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2362448 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e0530c5760002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2362450 INFO  (jetty-launcher-2664-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33783/solr
   [junit4]   2> 2362450 INFO  (jetty-launcher-2664-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:33783/solr
   [junit4]   2> 2362481 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2362481 INFO  (jetty-launcher-2664-thread-1) [n:127.0.0.1:45985_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2362482 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45243_solr
   [junit4]   2> 2362482 INFO  (jetty-launcher-2664-thread-1) [n:127.0.0.1:45985_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45985_solr
   [junit4]   2> 2362482 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.s.c.Overseer Overseer (id=98521948878143493-127.0.0.1:45243_solr-n_0000000000) starting
   [junit4]   2> 2362483 INFO  (zkCallback-2676-thread-1-processing-n:127.0.0.1:45985_solr) [n:127.0.0.1:45985_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2362483 INFO  (zkCallback-2675-thread-1-processing-n:127.0.0.1:45243_solr) [n:127.0.0.1:45243_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2362488 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45243_solr
   [junit4]   2> 2362489 INFO  (zkCallback-2676-thread-1-processing-n:127.0.0.1:45985_solr) [n:127.0.0.1:45985_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2362492 INFO  (zkCallback-2675-thread-2-processing-n:127.0.0.1:45243_solr) [n:127.0.0.1:45243_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2362507 INFO  (jetty-launcher-2664-thread-1) [n:127.0.0.1:45985_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
   [junit4]   2> 2362507 INFO  (jetty-launcher-2664-thread-1) [n:127.0.0.1:45985_solr    ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=jenkins, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, zk-dt-secret-manager.enable=true, proxyuser.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, proxyuser.anyHostAnyUser.hosts=*, signer.secret.provider=zookeeper}
   [junit4]   2> 2362507 INFO  (jetty-launcher-2664-thread-1) [n:127.0.0.1:45985_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 2362508 INFO  (jetty-launcher-2664-thread-1-EventThread) [n:127.0.0.1:45985_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 2362530 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HadoopAuthPlugin
   [junit4]   2> 2362530 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.s.s.HadoopAuthPlugin Params: {proxyuser.anyHostUsersGroup.hosts=*, proxyuser.wrongHost.hosts=1.1.1.1.1.1, proxyuser.bogusGroup.groups=__some_bogus_group, proxyuser.localHostAnyGroup.groups=*, cookie.domain=127.0.0.1, proxyuser.wrongHost.groups=*, type=simple, proxyuser.noHosts.groups=*, proxyuser.anyHostUsersGroup.groups=jenkins, proxyuser.noGroups.hosts=*, proxyuser.anyHostAnyUser.groups=*, delegation-token.token-kind=solr-dt, proxyuser.bogusGroup.hosts=*, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, signer.secret.provider.zookeeper.path=/token, zk-dt-secret-manager.enable=true, proxyuser.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, proxyuser.anyHostAnyUser.hosts=*, signer.secret.provider=zookeeper}
   [junit4]   2> 2362531 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 2362532 INFO  (jetty-launcher-2664-thread-2-EventThread) [n:127.0.0.1:45243_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 2362545 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
   [junit4]   2> 2362568 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45243.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e6d5e94
   [junit4]   2> 2362573 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45243.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e6d5e94
   [junit4]   2> 2362573 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45243.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e6d5e94
   [junit4]   2> 2362574 INFO  (jetty-launcher-2664-thread-2) [n:127.0.0.1:45243_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_8983C477E607B9CC-001/tempDir-001/node2/.
   [junit4]   2> 2363521 INFO  (jetty-launcher-2664-thread-1) [n:127.0.0.1:45985_solr    ] o.a.s.c.CoreContainer PKIAuthenticationPlugin is managing internode requests
   [junit4]   2> 2363553 INFO  (jetty-launcher-2664-thread-1) [n:127.0.0.1:45985_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45985.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e6d5e94
   [junit4]   2> 2363559 INFO  (jetty-launcher-2664-thread-1) [n:127.0.0.1:45985_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45985.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e6d5e94
   [junit4]   2> 2363559 INFO  (jetty-launcher-2664-thread-1) [n:127.0.0.1:45985_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45985.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e6d5e94
   [junit4]   2> 2363560 INFO  (jetty-launcher-2664-thread-1) [n:127.0.0.1:45985_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.security.hadoop.TestImpersonationWithHadoopAuth_8983C477E607B9CC-001/tempDir-001/node1/.
   [junit4]   2> 2363577 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[8983C477E607B9CC]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2363577 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[8983C477E607B9CC]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:33783/solr ready
   [junit4]   2> 2363588 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
   [junit4]   2> 2363591 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[8983C477E607B9CC]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=simple-dt&e=1503361637217&s=EmIgmlcgBqtq4dYBANyTMcfkWN4="; Domain=127.0.0.1; Expires= ., 22- . .-2017 00:27:17 GMT; HttpOnly". Invalid 'expires' attribute: ., 22- . .-2017 00:27:17 GMT
   [junit4]   2> 2363591 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigHosts-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
   [junit4] IGNOR/A 0.00s J1 | TestImpersonationWithHadoopAuth.testForwarding
   [junit4]    > Assumption #1: 'awaitsfix' test group is disabled (@AwaitsFix(bugUrl=https://issues.apache.org/jira/browse/HADOOP-9893))
   [junit4]   2> 2363601 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
   [junit4]   2> 2378615 WARN  (jetty-launcher-2664-thread-2-SendThread(127.0.0.1:33783)) [n:127.0.0.1:45243_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15092ms for sessionid 0x15e0530c5760008
   [junit4]   2> 2378615 WARN  (jetty-launcher-2664-thread-1-SendThread(127.0.0.1:33783)) [n:127.0.0.1:45985_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15055ms for sessionid 0x15e0530c5760006
   [junit4]   2> 2378615 WARN  (jetty-launcher-2664-thread-2-SendThread(127.0.0.1:33783)) [n:127.0.0.1:45243_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 16022ms for sessionid 0x15e0530c5760005
   [junit4]   2> 2378615 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e0530c5760006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2378615 WARN  (jetty-launcher-2664-thread-1-SendThread(127.0.0.1:33783)) [n:127.0.0.1:45985_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15092ms for sessionid 0x15e0530c5760007
   [junit4]   2> 2378615 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e0530c5760008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2378615 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e0530c5760007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2378615 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e0530c5760005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2378616 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[8983C477E607B9CC]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=simple-dt&e=1503361637230&s=FfUSn2DClIG9IFN1zYBpyDs0UbI="; Domain=127.0.0.1; Expires= ., 22- . .-2017 00:27:17 GMT; HttpOnly". Invalid 'expires' attribute: ., 22- . .-2017 00:27:17 GMT
   [junit4]   2> 2378616 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyWrongHost-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
   [junit4]   2> 2378630 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
   [junit4]   2> 2378631 INFO  (qtp347145329-21889) [n:127.0.0.1:45243_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&user.name=localHostAnyGroup&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2378631 INFO  (qtp347145329-21889) [n:127.0.0.1:45243_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&user.name=localHostAnyGroup&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2378631 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[8983C477E607B9CC]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=simple-dt&e=1503361652259&s=Lv92fnC4BKgh0wwhlL7seMfFNC8="; Domain=127.0.0.1; Expires= ., 22- . .-2017 00:27:32 GMT; HttpOnly". Invalid 'expires' attribute: ., 22- . .-2017 00:27:32 GMT
   [junit4]   2> 2378632 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateHost-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
   [junit4]   2> 2378658 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
   [junit4]   2> 2378664 WARN  (qtp347145329-21889) [n:127.0.0.1:45243_solr    ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: ‘bar’: no such user
   [junit4]   2> id: ‘bar’: no such user
   [junit4]   2> 
   [junit4]   2> 2378665 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[8983C477E607B9CC]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=simple-dt&e=1503361652287&s=JGudMsjM7SIwh5JjZs20XtnMf6A="; Domain=127.0.0.1; Expires= ., 22- . .-2017 00:27:32 GMT; HttpOnly". Invalid 'expires' attribute: ., 22- . .-2017 00:27:32 GMT
   [junit4]   2> 2378666 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidGroup-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
   [junit4]   2> 2378681 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
   [junit4]   2> 2378684 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[8983C477E607B9CC]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=simple-dt&e=1503361652311&s=iouUNs6J+fCHkK/Oq6Y0pVX4HRY="; Domain=127.0.0.1; Expires= ., 22- . .-2017 00:27:32 GMT; HttpOnly". Invalid 'expires' attribute: ., 22- . .-2017 00:27:32 GMT
   [junit4]   2> 2378684 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyInvalidProxyUser-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
   [junit4]   2> 2378700 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
   [junit4]   2> 2378701 INFO  (qtp347145329-21885) [n:127.0.0.1:45243_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&user.name=anyHostAnyUser&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2378701 INFO  (qtp347145329-21885) [n:127.0.0.1:45243_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&user.name=anyHostAnyUser&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2378701 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[8983C477E607B9CC]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=simple-dt&e=1503361652329&s=Q8ZvTeEOlkSH/SJH7eCwyG3wzVI="; Domain=127.0.0.1; Expires= ., 22- . .-2017 00:27:32 GMT; HttpOnly". Invalid 'expires' attribute: ., 22- . .-2017 00:27:32 GMT
   [junit4]   2> 2378701 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateAnyHostAnyUser-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
   [junit4]   2> 2378714 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
   [junit4]   2> 2378715 INFO  (jetty-launcher-2664-thread-2-EventThread) [n:127.0.0.1:45243_solr    ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
   [junit4]   2> 2378718 WARN  (zkCallback-2682-thread-3) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@dfa3a94 name: ZooKeeperConnection Watcher:127.0.0.1:33783/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 2378718 WARN  (zkCallback-2682-thread-3) [    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 2378718 WARN  (zkCallback-2675-thread-1-processing-n:127.0.0.1:45243_solr) [n:127.0.0.1:45243_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@1651814f name: ZooKeeperConnection Watcher:127.0.0.1:33783/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 2378718 WARN  (zkCallback-2675-thread-1-processing-n:127.0.0.1:45243_solr) [n:127.0.0.1:45243_solr    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 2378718 WARN  (zkCallback-2676-thread-1-processing-n:127.0.0.1:45985_solr) [n:127.0.0.1:45985_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@57b70c27 name: ZooKeeperConnection Watcher:127.0.0.1:33783/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 2378718 WARN  (zkCallback-2676-thread-1-processing-n:127.0.0.1:45985_solr) [n:127.0.0.1:45985_solr    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 2378723 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[8983C477E607B9CC]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=simple-dt&e=1503361652346&s=93BgVHfF9a8AonK6b3mtYGhjsSM="; Domain=127.0.0.1; Expires= ., 22- . .-2017 00:27:32 GMT; HttpOnly". Invalid 'expires' attribute: ., 22- . .-2017 00:27:32 GMT
   [junit4]   2> 2378724 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNoConfigGroups-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
   [junit4]   2> 2378734 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNullProxyUser-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
   [junit4]   2> 2378736 INFO  (qtp347145329-21881) [    ] o.a.s.s.SolrDispatchFilter Error authenticating
   [junit4]   2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:195)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthFilter.doFilter(HadoopAuthFilter.java:110)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthPlugin.doAuthenticate(HadoopAuthPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:449)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:324)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2378736 WARN  (qtp347145329-21881) [    ] o.e.j.s.ServletHandler /solr/admin/collections
   [junit4]   2> org.apache.solr.common.SolrException: Error during request authentication, 
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:455)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:345)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:324)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.PseudoAuthenticationHandler.authenticate(PseudoAuthenticationHandler.java:195)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthFilter.doFilter(HadoopAuthFilter.java:110)
   [junit4]   2> 	at org.apache.solr.security.HadoopAuthPlugin.doAuthenticate(HadoopAuthPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:449)
   [junit4]   2> 	... 26 more
   [junit4]   2> 2378738 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyNullProxyUser-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
   [junit4]   2> 2378750 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
   [junit4]   2> 2378751 INFO  (qtp347145329-21891) [n:127.0.0.1:45243_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&user.name=anyHostUsersGroup&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2378751 INFO  (qtp347145329-21891) [n:127.0.0.1:45243_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&user.name=anyHostUsersGroup&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2378752 WARN  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[8983C477E607B9CC]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=simple-dt&e=1503361652379&s=REQGsdi1z1xRmqdlyRpcUH8l3jA="; Domain=127.0.0.1; Expires= ., 22- . .-2017 00:27:32 GMT; HttpOnly". Invalid 'expires' attribute: ., 22- . .-2017 00:27:32 GMT
   [junit4]   2> 2378752 INFO  (TEST-TestImpersonationWithHadoopAuth.testProxyValidateGroup-seed#[8983C477E607B9CC]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
   [junit4]   2> 2379477 INFO  (jetty-closer-2665-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@54851cea{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2379477 INFO  (jetty-closer-2665-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@2bf0f6fd{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2379477 INFO  (jetty-closer-2665-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1442998256
   [junit4]   2> 2379477 INFO  (jetty-closer-2665-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1354012084
   [junit4]   2> 2379477 INFO  (jetty-closer-2665-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2379477 INFO  (jetty-closer-2665-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2379477 INFO  (jetty-closer-2665-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2675e577: rootName = solr_45985, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@17f1ddcb
   [junit4]   2> 2379477 INFO  (jetty-closer-2665-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3c942b6a: rootName = solr_45243, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1ab100f
   [junit4]   2> 2379481 INFO  (jetty-closer-2665-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2379481 INFO  (jetty-closer-2665-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@43f9e7f2: rootName = solr_45985, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5144bae5
   [junit4]   2> 2379481 INFO  (jetty-closer-2665-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2379481 INFO  (jetty-closer-2665-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5124eaa8: rootName = solr_45243, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@5144bae5
   [junit4]   2> 2379484 INFO  (jetty-closer-2665-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2379484 INFO  (jetty-closer-2665-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@10030dc3: rootName = solr_45243, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@52072622
   [junit4]   2> 2379484 INFO  (jetty-closer-2665-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2379484 INFO  (jetty-closer-2665-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1152403f: rootName = solr_45985, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@52072622
   [junit4]   2> 2379732 INFO  (jetty-launcher-2664-thread-1-EventThread) [n:127.0.0.1:45985_solr    ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
   [junit4]   2> 2380209 INFO  (jetty-closer-2665-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 2380209 INFO  (jetty-closer-2665-thread-2) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2380209 WARN  (zkCallback-2676-thread-3-processing-n:127.0.0.1:45985_solr) [n:127.0.0.1:45985_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2380209 ERROR (Thread[Thread-8508,5,TGRP-TestImpersonationWithHadoopAuth]) [n:127.0.0.1:45985_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 2380210 INFO  (jetty-closer-2665-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@453203b7{/solr,null,UNAVAILABLE}
   [junit4]   2> 2380598 INFO  (zkCallback-2675-thread-2-processing-n:127.0.0.1:45243_solr) [n:127.0.0.1:45243_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 2380599 INFO  (jetty-closer-2665-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 2380599 INFO  (jetty-closer-2665-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2380599 INFO  (jetty-closer-2665-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98521948878143493-127.0.0.1:45243_solr-n_0000000000) closing
   [junit4]   2> 2380599 INFO  (OverseerStateUpdate-98521948878143493-127.0.0.1:45243_solr-n_0000000000) [n:127.0.0.1:45243_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45243_solr
   [junit4]   2> 2380599 WARN  (zkCallback-2675-thread-2-processing-n:127.0.0.1:45243_solr) [n:127.0.0.1:45243_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2380599 ERROR (Thread[Thread-8505,5,TGRP-TestImpersonationWithHadoopAuth]) [n:127.0.0.1:45243_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 2380600 INFO  (jetty-closer-2665-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7ca4c1b5{/solr,null,UNAVAILABLE}
   [junit4]   2> 2380601 ERROR (SUITE-TestImpersonationWithHadoopAuth-seed#[8983C477E607B9CC]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2380601 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[8983C477E607B9CC]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33783 33783
   [junit4]   2> 2385633 INFO  (Thread-8488) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:33783 33783
   [junit4]   2> 2385634 WARN  (Thread-8488) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
   [junit4]   2> 
   [junit4]   2> 2385634 INFO  (SUITE-TestImpersonationWithHadoopAuth-seed#[8983C477E607B9CC]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Aug 21, 2017 2:27:39 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> Aug 21, 2017 2:27:59 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 
   [junit4]   2>    1) Thread[id=21925, name=jetty-launcher-2664-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2>         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2>    2) Thread[id=21929, name=jetty-launcher-2664-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2>         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2> Aug 21, 2017 2:27:59 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=21925, name=jetty-launcher-2664-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]   2>    2) Thread[id=21929, name=jetty-launcher-2664-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]   2> 2405757 ERROR (jetty-launcher-2664-thread-2-EventThread) [n:127.0.0.1:45243_solr    ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2> 	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2> 	at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2> 	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2> 2405757 ERROR (jetty-launcher-2664-thread-1-EventThread) [n:127.0.0.1:45985_solr    ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2> 	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2> 	at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2> 	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2> Aug 21, 2017 2:27:59 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1862, maxMBSortInHeap=6.147020502154096, sim=RandomSimilarity(queryNorm=false): {}, locale=th, timezone=America/Montserrat
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=257468168,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [CdcrUpdateLogTest, BJQParserTest, AlternateDirectoryTest, TestPartialUpdateDeduplication, TestJsonRequest, TestCollationFieldDocValues, LeaderInitiatedRecoveryOnShardRestartTest, StressHdfsTest, ChaosMonkeySafeLeaderWithPullReplicasTest, SampleTest, BlockCacheTest, DistributedFacetPivotSmallTest, TestCorePropertiesReload, HdfsTlogReplayBufferedWhileIndexingTest, TestSimpleTextCodec, TestManagedSynonymGraphFilterFactory, TestXmlQParserPlugin, TestLegacyTerms, TestNumericRangeQuery64, TestCoreContainer, SegmentsInfoRequestHandlerTest, ReplaceNodeTest, PeerSyncReplicationTest, ZkControllerTest, PreAnalyzedFieldManagedSchemaCloudTest, TestFileDictionaryLookup, TestImplicitCoreProperties, TestUseDocValuesAsStored2, ResourceLoaderTest, MultiThreadedOCPTest, TestSolrCloudSnapshots, PrimUtilsTest, TestStressUserVersions, TestRTGBase, TestFieldTypeResource, TestConfigSetsAPI, TestValueSourceCache, FileBasedSpellCheckerTest, TestHdfsBackupRestoreCore, HealthCheckHandlerTest, MoveReplicaHDFSTest, TestNamedUpdateProcessors, TestRandomCollapseQParserPlugin, TestRuleBasedAuthorizationPlugin, SolrIndexMetricsTest, InfixSuggestersTest, DeleteShardTest, ShardRoutingTest, TestBulkSchemaConcurrent, DocValuesTest, TestCharFilters, SoftAutoCommitTest, HdfsRestartWhileUpdatingTest, TestFieldCollectionResource, TestXIncludeConfig, DocExpirationUpdateProcessorFactoryTest, TestElisionMultitermQuery, CacheHeaderTest, HttpSolrCallGetCoreTest, TestLegacyFieldCache, CoreAdminRequestStatusTest, CursorMarkTest, MoreLikeThisHandlerTest, ClusterStateUpdateTest, TestDistributedStatsComponentCardinality, PKIAuthenticationIntegrationTest, BigEndianAscendingWordSerializerTest, TestStressInPlaceUpdates, TestManagedSchemaAPI, TestSolrCoreParser, TestPostingsSolrHighlighter, QueryParsingTest, TestRTimerTree, SystemInfoHandlerTest, DistributedVersionInfoTest, TestClassicSimilarityFactory, BasicFunctionalityTest, TestCloudInspectUtil, TestSimpleTrackingShardHandler, TestMinMaxOnMultiValuedField, ShardSplitTest, TestCollapseQParserPlugin, TestEmbeddedSolrServerSchemaAPI, TestStressVersions, TestGraphTermsQParserPlugin, DirectSolrConnectionTest, TestSolrIndexConfig, TestFastLRUCache, SolrCmdDistributorTest, TestLegacyNumericRangeQueryBuilder, TestNRTOpen, TestCoreDiscovery, SimpleCollectionCreateDeleteTest, TestCloudPseudoReturnFields, TermVectorComponentTest, TestMacros, ZkStateWriterTest, UninvertDocValuesMergePolicyTest, CdcrRequestHandlerTest, CdcrBootstrapTest, TestPushWriter, IndexSchemaTest, SparseHLLTest, TestSweetSpotSimilarityFactory, TestManagedResourceStorage, DOMUtilTest, TestMultiWordSynonyms, TestIntervalFaceting, SliceStateTest, TestFieldCacheSortRandom, SchemaVersionSpecificBehaviorTest, CloudExitableDirectoryReaderTest, PreAnalyzedUpdateProcessorTest, TriLevelCompositeIdRoutingTest, DistributedQueryComponentOptimizationTest, SolrGangliaReporterTest, TestSchemaSimilarityResource, OpenCloseCoreStressTest, TestStressRecovery, TestFieldCache, UpdateLogTest, DocValuesNotIndexedTest, HttpPartitionTest, SolrXmlInZkTest, TestAuthenticationFramework, TestClusterProperties, TestCollectionsAPIViaSolrCloudCluster, TestLocalFSCloudBackupRestore, TestMiniSolrCloudClusterSSL, TestPullReplicaErrorHandling, TestRandomRequestDistribution, TestReplicaProperties, TestShortCircuitedRequests, TestTolerantUpdateProcessorCloud, TestPolicyCloud, HdfsRecoveryZkTest, BlobRepositoryCloudTest, CoreSorterTest, DirectoryFactoryTest, ExitableDirectoryReaderTest, QueryResultKeyTest, TestBackupRepositoryFactory, TestConfigSetImmutable, TestConfigSetProperties, TestInfoStreamLogging, TestInitParams, RequestLoggingTest, SearchHandlerTest, TestBlobHandler, DistributedFacetExistsSmallTest, DistributedFacetPivotLongTailTest, DistributedSuggestComponentTest, TestExpandComponent, TestHttpShardHandlerFactory, JavabinLoaderTest, WrapperMergePolicyFactoryTest, TestLegacyField, TestLegacyNumericUtils, JvmMetricsTest, SolrMetricManagerTest, SolrGraphiteReporterTest, SolrCloudReportersTest, ManagedSchemaRoundRobinCloudTest, TestSchemaManager, AnalyticsQueryTest, MergeStrategyTest, TestOverriddenPrefixQueryForCustomFieldType, TestPayloadScoreQParserPlugin, TestRecoveryHdfs, BlockJoinFacetRandomTest, BlockJoinFacetSimpleTest, TestNestedDocsSort, TestScoreJoinQPNoScore, TestLRUStatsCache, TestSha256AuthenticationProvider, TestDelegationWithHadoopAuth, TestImpersonationWithHadoopAuth]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestImpersonationWithHadoopAuth -Dtests.seed=8983C477E607B9CC -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=th -Dtests.timezone=America/Montserrat -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J1 | TestImpersonationWithHadoopAuth (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.security.hadoop.TestImpersonationWithHadoopAuth: 
   [junit4]    >    1) Thread[id=21925, name=jetty-launcher-2664-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]    >         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]    >         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]    >         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]    >         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]    >    2) Thread[id=21929, name=jetty-launcher-2664-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestImpersonationWithHadoopAuth]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]    >         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]    >         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]    >         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]    >         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]    >         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]    >         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([8983C477E607B9CC]:0)
   [junit4] Completed [729/730 (1!)] on J1 in 43.50s, 10 tests, 1 error, 1 skipped <<< FAILURES!

[...truncated 43271 lines...]

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+181) - Build # 20379 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20379/
Java: 64bit/jdk-9-ea+181 -XX:+UseCompressedOops -XX:+UseParallelGC --illegal-access=deny

3 tests failed.
FAILED:  org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader

Error Message:
Doc with id=1 not found in http://127.0.0.1:43369/ub/h/forceleader_test_collection due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:43369/ub/h/forceleader_test_collection due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([96DE1B3AD690F101:70492FFAEF120860]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:556)
	at org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader(ForceLeaderTest.java:142)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
count1=6, count2=6 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: count1=6, count2=6 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([96DE1B3AD690F101:C93A360DBD9C6244]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:90)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping

Error Message:
Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.

Stack Trace:
java.lang.AssertionError: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
	at __randomizedtesting.SeedInfo.seed([96DE1B3AD690F101:E73AE5ECA07BD6CD]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 11718 lines...]
   [junit4] Suite: org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest
   [junit4]   2> 868283 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_96DE1B3AD690F101-001/init-core-data-001
   [junit4]   2> 868283 WARN  (SUITE-UpdateRequestProcessorFactoryTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=33 numCloses=33
   [junit4]   2> 868283 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 868284 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 868284 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 868540 WARN  (coreLoadExecutor-3467-thread-1) [    ] o.a.s.c.RequestHandlers no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 868541 WARN  (coreLoadExecutor-3467-thread-1) [    ] o.a.s.r.ManagedResourceStorage Cannot write to config directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 868543 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 868544 INFO  (TEST-UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testUpdateDistribChainSkipping
   [junit4]   2> 868544 INFO  (TEST-UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testUpdateDistribChainSkipping
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UpdateRequestProcessorFactoryTest -Dtests.method=testUpdateDistribChainSkipping -Dtests.seed=96DE1B3AD690F101 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=xog-UG -Dtests.timezone=America/Guyana -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.00s J1 | UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([96DE1B3AD690F101:E73AE5ECA07BD6CD]:0)
   [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 868546 INFO  (TEST-UpdateRequestProcessorFactoryTest.testRequestTimeUrp-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testRequestTimeUrp
   [junit4]   2> 868547 INFO  (TEST-UpdateRequestProcessorFactoryTest.testRequestTimeUrp-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testRequestTimeUrp
   [junit4]   2> 868548 INFO  (TEST-UpdateRequestProcessorFactoryTest.testConfiguration-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testConfiguration
   [junit4]   2> 868548 INFO  (TEST-UpdateRequestProcessorFactoryTest.testConfiguration-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testConfiguration
   [junit4]   2> 868548 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_96DE1B3AD690F101-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=113, maxMBSortInHeap=6.147032901445707, sim=RandomSimilarity(queryNorm=true): {}, locale=xog-UG, timezone=America/Guyana
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 9 (64-bit)/cpus=8,threads=1,free=217100904,total=516423680
   [junit4]   2> NOTE: All tests run in this JVM: [FileUtilsTest, ExitableDirectoryReaderTest, CSVRequestHandlerTest, TestLegacyFieldReuse, JsonLoaderTest, AlternateDirectoryTest, DistributedFacetPivotWhiteBoxTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, AtomicUpdatesTest, DirectSolrSpellCheckerTest, CoreAdminHandlerTest, ClusterStateUpdateTest, LeaderInitiatedRecoveryOnCommitTest, HdfsLockFactoryTest, TestPullReplica, TestDistributedGrouping, TestFreeTextSuggestions, TestLeaderInitiatedRecoveryThread, TestRandomRequestDistribution, SolrCloudExampleTest, TestComplexPhraseLeadingWildcard, TestCoreContainer, BlockJoinFacetDistribTest, TestBM25SimilarityFactory, TestSubQueryTransformerDistrib, ConnectionReuseTest, TestSweetSpotSimilarityFactory, RemoteQueryErrorTest, TestCloudManagedSchema, HdfsChaosMonkeySafeLeaderTest, TestTrieFacet, DistributedIntervalFacetingTest, TestRTGBase, TestGraphMLResponseWriter, TestSolrConfigHandlerConcurrent, V2StandaloneTest, MetricsConfigTest, ZkSolrClientTest, HighlighterTest, DOMUtilTest, TestSimpleTrackingShardHandler, TestFieldResource, TestInfoStreamLogging, TestCursorMarkWithoutUniqueKey, CurrencyFieldTypeTest, MissingSegmentRecoveryTest, TestCloudDeleteByQuery, HLLSerializationTest, SolrCmdDistributorTest, SystemInfoHandlerTest, JSONWriterTest, IndexSchemaRuntimeFieldTest, TestChildDocTransformer, ZkFailoverTest, VersionInfoTest, ChaosMonkeySafeLeaderTest, TestSolrIndexConfig, HdfsBasicDistributedZk2Test, TestSegmentSorting, TestSQLHandler, TestSolrCloudWithHadoopAuthPlugin, OpenCloseCoreStressTest, TestCustomDocTransformer, TestConfigSetProperties, ScriptEngineTest, TestPayloadScoreQParserPlugin, BlockDirectoryTest, TestSchemaNameResource, TestPostingsSolrHighlighter, TestCustomStream, LoggingHandlerTest, HdfsRecoverLeaseTest, DocValuesTest, MetricUtilsTest, AddBlockUpdateTest, BasicFunctionalityTest, CollectionsAPIDistributedZkTest, DistributedMLTComponentTest, TestReloadDeadlock, TestRawResponseWriter, SOLR749Test, ReplicaListTransformerTest, TestFiltering, TestNoOpRegenerator, HdfsUnloadDistributedZkTest, SolrMetricReporterTest, ConnectionManagerTest, MoveReplicaTest, TestSolrCLIRunExample, PropertiesRequestHandlerTest, TestPerFieldSimilarity, TestRestManager, ResponseHeaderTest, TestUnifiedSolrHighlighter, UpdateRequestProcessorFactoryTest]
   [junit4] Completed [287/732 (1!)] on J1 in 0.31s, 3 tests, 1 failure <<< FAILURES!

[...truncated 58 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> 941139 INFO  (SUITE-SolrSlf4jReporterTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_96DE1B3AD690F101-001/init-core-data-001
   [junit4]   2> 941139 WARN  (SUITE-SolrSlf4jReporterTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
   [junit4]   2> 941139 INFO  (SUITE-SolrSlf4jReporterTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 941139 INFO  (SUITE-SolrSlf4jReporterTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 941140 INFO  (TEST-SolrSlf4jReporterTest.testReporter-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testReporter
   [junit4]   2> 947386 INFO  (TEST-SolrSlf4jReporterTest.testReporter-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testReporter
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=96DE1B3AD690F101 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lag-TZ -Dtests.timezone=Universal -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 6.25s J1 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: count1=6, count2=6 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([96DE1B3AD690F101:C93A360DBD9C6244]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:90)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 947386 INFO  (SUITE-SolrSlf4jReporterTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_96DE1B3AD690F101-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=true): {}, locale=lag-TZ, timezone=Universal
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 9 (64-bit)/cpus=8,threads=1,free=133044544,total=516423680
   [junit4]   2> NOTE: All tests run in this JVM: [FileUtilsTest, ExitableDirectoryReaderTest, CSVRequestHandlerTest, TestLegacyFieldReuse, JsonLoaderTest, AlternateDirectoryTest, DistributedFacetPivotWhiteBoxTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, AtomicUpdatesTest, DirectSolrSpellCheckerTest, CoreAdminHandlerTest, ClusterStateUpdateTest, LeaderInitiatedRecoveryOnCommitTest, HdfsLockFactoryTest, TestPullReplica, TestDistributedGrouping, TestFreeTextSuggestions, TestLeaderInitiatedRecoveryThread, TestRandomRequestDistribution, SolrCloudExampleTest, TestComplexPhraseLeadingWildcard, TestCoreContainer, BlockJoinFacetDistribTest, TestBM25SimilarityFactory, TestSubQueryTransformerDistrib, ConnectionReuseTest, TestSweetSpotSimilarityFactory, RemoteQueryErrorTest, TestCloudManagedSchema, HdfsChaosMonkeySafeLeaderTest, TestTrieFacet, DistributedIntervalFacetingTest, TestRTGBase, TestGraphMLResponseWriter, TestSolrConfigHandlerConcurrent, V2StandaloneTest, MetricsConfigTest, ZkSolrClientTest, HighlighterTest, DOMUtilTest, TestSimpleTrackingShardHandler, TestFieldResource, TestInfoStreamLogging, TestCursorMarkWithoutUniqueKey, CurrencyFieldTypeTest, MissingSegmentRecoveryTest, TestCloudDeleteByQuery, HLLSerializationTest, SolrCmdDistributorTest, SystemInfoHandlerTest, JSONWriterTest, IndexSchemaRuntimeFieldTest, TestChildDocTransformer, ZkFailoverTest, VersionInfoTest, ChaosMonkeySafeLeaderTest, TestSolrIndexConfig, HdfsBasicDistributedZk2Test, TestSegmentSorting, TestSQLHandler, TestSolrCloudWithHadoopAuthPlugin, OpenCloseCoreStressTest, TestCustomDocTransformer, TestConfigSetProperties, ScriptEngineTest, TestPayloadScoreQParserPlugin, BlockDirectoryTest, TestSchemaNameResource, TestPostingsSolrHighlighter, TestCustomStream, LoggingHandlerTest, HdfsRecoverLeaseTest, DocValuesTest, MetricUtilsTest, AddBlockUpdateTest, BasicFunctionalityTest, CollectionsAPIDistributedZkTest, DistributedMLTComponentTest, TestReloadDeadlock, TestRawResponseWriter, SOLR749Test, ReplicaListTransformerTest, TestFiltering, TestNoOpRegenerator, HdfsUnloadDistributedZkTest, SolrMetricReporterTest, ConnectionManagerTest, MoveReplicaTest, TestSolrCLIRunExample, PropertiesRequestHandlerTest, TestPerFieldSimilarity, TestRestManager, ResponseHeaderTest, TestUnifiedSolrHighlighter, UpdateRequestProcessorFactoryTest, NoCacheHeaderTest, ConfigureRecoveryStrategyTest, TestFieldSortValues, TestCloudSearcherWarming, TestAtomicUpdateErrorCases, SolrSlf4jReporterTest]
   [junit4] Completed [307/732 (2!)] on J1 in 6.26s, 1 test, 1 failure <<< FAILURES!

[...truncated 705 lines...]
   [junit4] Suite: org.apache.solr.cloud.ForceLeaderTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_96DE1B3AD690F101-001/init-core-data-001
   [junit4]   2> 1472700 WARN  (SUITE-ForceLeaderTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=56 numCloses=56
   [junit4]   2> 1472700 INFO  (SUITE-ForceLeaderTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1472700 INFO  (SUITE-ForceLeaderTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776")
   [junit4]   2> 1472700 INFO  (SUITE-ForceLeaderTest-seed#[96DE1B3AD690F101]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1472703 ERROR (Thread-3078) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1472893 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1474168 WARN  (qtp1576559203-14789) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1475356 WARN  (OverseerThreadFactory-5541-thread-2) [    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 1475629 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1476777 WARN  (qtp317187013-14831) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1477038 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1478522 WARN  (qtp585313575-14870) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1478809 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1479995 WARN  (qtp249519881-14902) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1480029 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testReplicasInLIRNoLeader
   [junit4]   2> 1481380 WARN  (qtp317187013-14837) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1481399 WARN  (qtp1576559203-14782) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1481400 WARN  (qtp249519881-14903) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1483489 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.SocketProxy Closing 4 connections to: http://127.0.0.1:40777/ub/h, target: http://127.0.0.1:44443/ub/h
   [junit4]   2> 1483489 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.SocketProxy Closing 2 connections to: http://127.0.0.1:43369/ub/h, target: http://127.0.0.1:41173/ub/h
   [junit4]   2> 1483490 ERROR (updateExecutor-3639-thread-2) [    ] o.a.s.u.ErrorReportingConcurrentUpdateSolrClient error
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1483491 ERROR (updateExecutor-3639-thread-1) [    ] o.a.s.u.ErrorReportingConcurrentUpdateSolrClient error
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1483491 WARN  (qtp317187013-14832) [    ] o.a.s.u.p.DistributedUpdateProcessor Error sending update to http://127.0.0.1:40777/ub/h
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1483491 ERROR (qtp317187013-14832) [    ] o.a.s.u.p.DistributedUpdateProcessor Setting up to try to start recovery on replica http://127.0.0.1:40777/ub/h/forceleader_test_collection_shard1_replica_t2/
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1483492 WARN  (qtp317187013-14832) [    ] o.a.s.u.p.DistributedUpdateProcessor Error sending update to http://127.0.0.1:43369/ub/h
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1483492 ERROR (qtp317187013-14832) [    ] o.a.s.u.p.DistributedUpdateProcessor Setting up to try to start recovery on replica http://127.0.0.1:43369/ub/h/forceleader_test_collection_shard1_replica_t3/
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1483492 WARN  (updateExecutor-3639-thread-1) [    ] o.a.s.c.LeaderInitiatedRecoveryThread Leader is publishing core=forceleader_test_collection_shard1_replica_t2 coreNodeName =core_node6 state=down on behalf of un-reachable replica http://127.0.0.1:40777/ub/h/forceleader_test_collection_shard1_replica_t2/
   [junit4]   2> 1483492 WARN  (updateExecutor-3639-thread-2) [    ] o.a.s.c.LeaderInitiatedRecoveryThread Leader is publishing core=forceleader_test_collection_shard1_replica_t3 coreNodeName =core_node5 state=down on behalf of un-reachable replica http://127.0.0.1:43369/ub/h/forceleader_test_collection_shard1_replica_t3/
   [junit4]   2> 1483493 ERROR (updateExecutor-3639-thread-2) [    ] o.a.s.c.LeaderInitiatedRecoveryThread http://127.0.0.1:43369/ub/h: Could not tell a replica to recover:org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:43369/ub/h
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:634)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderInitiatedRecoveryThread.sendRecoveryCommandWithRetry(LeaderInitiatedRecoveryThread.java:209)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderInitiatedRecoveryThread.run(LeaderInitiatedRecoveryThread.java:95)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:43369 [/127.0.0.1] failed: Connection refused (Connection refused)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
   [junit4]   2> 	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:353)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:380)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:526)
   [junit4]   2> 	... 10 more
   [junit4]   2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
   [junit4]   2> 	at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)
   [junit4]   2> 	at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)
   [junit4]   2> 	at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)
   [junit4]   2> 	at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)
   [junit4]   2> 	at java.base/java.net.Socket.connect(Socket.java:591)
   [junit4]   2> 	at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:74)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:134)
   [junit4]   2> 	... 20 more
   [junit4]   2> 
   [junit4]   2> 1483493 ERROR (updateExecutor-3639-thread-1) [    ] o.a.s.c.LeaderInitiatedRecoveryThread http://127.0.0.1:40777/ub/h: Could not tell a replica to recover:org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:40777/ub/h
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:634)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderInitiatedRecoveryThread.sendRecoveryCommandWithRetry(LeaderInitiatedRecoveryThread.java:209)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderInitiatedRecoveryThread.run(LeaderInitiatedRecoveryThread.java:95)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:40777 [/127.0.0.1] failed: Connection refused (Connection refused)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
   [junit4]   2> 	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:353)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:380)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:526)
   [junit4]   2> 	... 10 more
   [junit4]   2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
   [junit4]   2> 	at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)
   [junit4]   2> 	at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)
   [junit4]   2> 	at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)
   [junit4]   2> 	at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)
   [junit4]   2> 	at java.base/java.net.Socket.connect(Socket.java:591)
   [junit4]   2> 	at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:74)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:134)
   [junit4]   2> 	... 20 more
   [junit4]   2> 
   [junit4]   2> 1485492 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.SocketProxy Closing 6 connections to: http://127.0.0.1:43465/ub/h, target: http://127.0.0.1:33449/ub/h
   [junit4]   2> 1488494 WARN  (updateExecutor-3639-thread-2) [    ] o.a.s.c.LeaderInitiatedRecoveryThread Stop trying to send recovery command to downed replica core=forceleader_test_collection_shard1_replica_t3 coreNodeName=core_node5 on 127.0.0.1:43369_ub%2Fh because my core container is closed.
   [junit4]   2> 1488494 WARN  (updateExecutor-3639-thread-1) [    ] o.a.s.c.LeaderInitiatedRecoveryThread Stop trying to send recovery command to downed replica core=forceleader_test_collection_shard1_replica_t2 coreNodeName=core_node6 on 127.0.0.1:40777_ub%2Fh because my core container is closed.
   [junit4]   2> 1488494 WARN  (zkCallback-3642-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1489498 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.s.i.CloudSolrClient Request to collection forceleader_test_collection failed due to (510) org.apache.solr.common.SolrException: Could not find a healthy node to handle the request., retry? 0
   [junit4]   2> 1489498 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.AbstractFullDistribZkTestBase ERROR: org.apache.solr.common.SolrException: Could not find a healthy node to handle the request. ... Sleeping for 1 seconds before re-try ...
   [junit4]   2> 1490498 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.s.i.CloudSolrClient Request to collection forceleader_test_collection failed due to (510) org.apache.solr.common.SolrException: Could not find a healthy node to handle the request., retry? 0
   [junit4]   2> 1490498 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.AbstractFullDistribZkTestBase ERROR: org.apache.solr.common.SolrException: Could not find a healthy node to handle the request. ... Sleeping for 1 seconds before re-try ...
   [junit4]   2> 1491301 WARN  (zkCallback-3654-thread-3) [    ] o.a.s.c.ShardLeaderElectionContext The previous leader marked me forceleader_test_collection_shard1_replica_t3 as down and I haven't recovered yet, so I shouldn't be the leader.
   [junit4]   2> 1491301 ERROR (zkCallback-3654-thread-3) [    ] o.a.s.c.ShardLeaderElectionContext There was a problem trying to register as the leader:org.apache.solr.common.SolrException: Leader Initiated Recovery prevented leadership
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.checkLIR(ElectionContext.java:549)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:431)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 1491498 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.s.i.CloudSolrClient Request to collection forceleader_test_collection failed due to (510) org.apache.solr.common.SolrException: Could not find a healthy node to handle the request., retry? 0
   [junit4]   2> 1491498 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.AbstractFullDistribZkTestBase ERROR: org.apache.solr.common.SolrException: Could not find a healthy node to handle the request. ... Sleeping for 1 seconds before re-try ...
   [junit4]   2> 1492498 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.s.i.CloudSolrClient Request to collection forceleader_test_collection failed due to (510) org.apache.solr.common.SolrException: Could not find a healthy node to handle the request., retry? 0
   [junit4]   2> 1492498 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.AbstractFullDistribZkTestBase ERROR: org.apache.solr.common.SolrException: Could not find a healthy node to handle the request. ... Sleeping for 1 seconds before re-try ...
   [junit4]   2> 1493499 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.s.i.CloudSolrClient Request to collection forceleader_test_collection failed due to (510) org.apache.solr.common.SolrException: Could not find a healthy node to handle the request., retry? 0
   [junit4]   2> 1493499 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.AbstractFullDistribZkTestBase ERROR: org.apache.solr.common.SolrException: Could not find a healthy node to handle the request. ... Sleeping for 1 seconds before re-try ...
   [junit4]   2> 1493613 ERROR (indexFetcher-5602-thread-1) [    ] o.a.s.h.ReplicationHandler Index fetch failed :org.apache.solr.common.SolrException: No registered leader was found after waiting for 4000ms , collection: forceleader_test_collection slice: shard1
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:758)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:744)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.getLeaderReplica(IndexFetcher.java:667)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:332)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:419)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(ReplicationHandler.java:1183)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.runAndReset(FutureTask.java:305)
   [junit4]   2> 	at java.base/java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:300)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 1494105 WARN  (zkCallback-3630-thread-2) [    ] o.a.s.c.ShardLeaderElectionContext The previous leader marked me forceleader_test_collection_shard1_replica_t2 as down and I haven't recovered yet, so I shouldn't be the leader.
   [junit4]   2> 1494105 ERROR (zkCallback-3630-thread-2) [    ] o.a.s.c.ShardLeaderElectionContext There was a problem trying to register as the leader:org.apache.solr.common.SolrException: Leader Initiated Recovery prevented leadership
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.checkLIR(ElectionContext.java:549)
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:431)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   2> 1494106 WARN  (zkCallback-3654-thread-3) [    ] o.a.s.c.RecoveryStrategy Stopping recovery for core=[forceleader_test_collection_shard1_replica_t3] coreNodeName=[core_node5]
   [junit4]   2> 1494499 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.s.i.CloudSolrClient Request to collection forceleader_test_collection failed due to (510) org.apache.solr.common.SolrException: Could not find a healthy node to handle the request., retry? 0
   [junit4]   2> 1494499 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.AbstractFullDistribZkTestBase No more retries available! Add batch failed due to: org.apache.solr.common.SolrException: Could not find a healthy node to handle the request.
   [junit4]   2> 1495308 ERROR (recoveryExecutor-3652-thread-1) [    ] o.a.s.c.RecoveryStrategy Error while trying to recover. core=forceleader_test_collection_shard1_replica_t3:org.apache.solr.common.SolrException: No registered leader was found after waiting for 4000ms , collection: forceleader_test_collection slice: shard1
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:758)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:744)
   [junit4]   2> 	at org.apache.solr.cloud.RecoveryStrategy.doSyncOrReplicateRecovery(RecoveryStrategy.java:517)
   [junit4]   2> 	at org.apache.solr.cloud.RecoveryStrategy.doRecovery(RecoveryStrategy.java:302)
   [junit4]   2> 	at org.apache.solr.cloud.RecoveryStrategy.run(RecoveryStrategy.java:286)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 
   [junit4]   1> -
   [junit4]   1> replica:core_node4 rstate:down live:false
   [junit4]   1> replica:core_node5 rstate:active live:true
   [junit4]   1> replica:core_node6 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   2> 1502081 WARN  (qtp249519881-14904) [    ] o.a.s.c.RecoveryStrategy Stopping recovery for core=[forceleader_test_collection_shard1_replica_t3] coreNodeName=[core_node5]
   [junit4]   2> 1502082 WARN  (qtp249519881-14904) [    ] o.a.s.c.RecoveryStrategy Stopping recovery for core=[forceleader_test_collection_shard1_replica_t3] coreNodeName=[core_node5]
   [junit4]   2> 1502084 WARN  (zkCallback-3630-thread-2) [    ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
   [junit4]   2> 1502787 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testReplicasInLIRNoLeader
   [junit4]   2> 1504298 WARN  (zkCallback-3630-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1504309 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e221d7f3a000c, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1505809 WARN  (zkCallback-3648-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1507321 WARN  (zkCallback-3654-thread-3) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1507322 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1507900 WARN  (Thread-3078) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 	3	/solr/collections/forceleader_test_collection/state.json
   [junit4]   2> 	3	/solr/collections/collection1/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/overseer_elect/election/98553751932633092-127.0.0.1:40777_ub%2Fh-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	3	/solr/overseer/queue
   [junit4]   2> 	3	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 1507900 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.SocketProxy Closing 14 connections to: http://127.0.0.1:43369/ub/h, target: http://127.0.0.1:41173/ub/h
   [junit4]   2> 1507900 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.SocketProxy Closing 3 connections to: http://127.0.0.1:38419/ub/h, target: http://127.0.0.1:43837/ub/h
   [junit4]   2> 1507900 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.SocketProxy Closing 4 connections to: http://127.0.0.1:40777/ub/h, target: http://127.0.0.1:44443/ub/h
   [junit4]   2> 1507900 WARN  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.SocketProxy Closing 0 connections to: http://127.0.0.1:43465/ub/h, target: http://127.0.0.1:33449/ub/h
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=ForceLeaderTest -Dtests.method=testReplicasInLIRNoLeader -Dtests.seed=96DE1B3AD690F101 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr-Latn-ME -Dtests.timezone=Canada/Saskatchewan -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 35.2s J1 | ForceLeaderTest.testReplicasInLIRNoLeader <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:43369/ub/h/forceleader_test_collection due to: Path not found: /id; rsp={doc=null}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([96DE1B3AD690F101:70492FFAEF120860]:0)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:556)
   [junit4]    > 	at org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader(ForceLeaderTest.java:142)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1507903 ERROR (Thread-3122) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1508080 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[96DE1B3AD690F101]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1509353 WARN  (qtp1046808147-15085) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1510535 WARN  (OverseerThreadFactory-5624-thread-2) [    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 1510804 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[96DE1B3AD690F101]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1511973 WARN  (qtp987918948-15132) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1512220 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[96DE1B3AD690F101]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1513365 WARN  (qtp1502231331-15166) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1513613 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[96DE1B3AD690F101]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1514762 WARN  (qtp585412387-15198) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1514797 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testLastPublishedStateIsActive
   [junit4]   2> 1516109 WARN  (qtp1502231331-15159) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1516118 WARN  (qtp987918948-15133) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1516139 WARN  (qtp585412387-15199) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 1526202 WARN  (qtp1502231331-15160) [    ] o.a.s.h.a.CollectionsHandler Force leader attempt 1. Waiting 5 secs for an active leader. State of the slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "base_url":"http://127.0.0.1:34923/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:34923_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t1",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "leader":"true",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "base_url":"http://127.0.0.1:46627/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:46627_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t2",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "base_url":"http://127.0.0.1:40835/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:40835_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t3",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"}}}
   [junit4]   2> 1531202 WARN  (qtp1502231331-15160) [    ] o.a.s.h.a.CollectionsHandler Force leader attempt 2. Waiting 5 secs for an active leader. State of the slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "base_url":"http://127.0.0.1:34923/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:34923_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t1",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "leader":"true",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "base_url":"http://127.0.0.1:46627/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:46627_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t2",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "base_url":"http://127.0.0.1:40835/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:40835_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t3",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"}}}
   [junit4]   2> 1536202 WARN  (qtp1502231331-15160) [    ] o.a.s.h.a.CollectionsHandler Force leader attempt 3. Waiting 5 secs for an active leader. State of the slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "base_url":"http://127.0.0.1:34923/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:34923_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t1",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "leader":"true",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "base_url":"http://127.0.0.1:46627/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:46627_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t2",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "base_url":"http://127.0.0.1:40835/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:40835_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t3",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"}}}
   [junit4]   2> 1541202 WARN  (qtp1502231331-15160) [    ] o.a.s.h.a.CollectionsHandler Force leader attempt 4. Waiting 5 secs for an active leader. State of the slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "base_url":"http://127.0.0.1:34923/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:34923_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t1",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "leader":"true",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "base_url":"http://127.0.0.1:46627/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:46627_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t2",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "base_url":"http://127.0.0.1:40835/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:40835_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t3",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"}}}
   [junit4]   2> 1546203 WARN  (qtp1502231331-15160) [    ] o.a.s.h.a.CollectionsHandler Force leader attempt 5. Waiting 5 secs for an active leader. State of the slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "base_url":"http://127.0.0.1:34923/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:34923_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t1",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "leader":"true",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "base_url":"http://127.0.0.1:46627/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:46627_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t2",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "base_url":"http://127.0.0.1:40835/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:40835_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t3",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"}}}
   [junit4]   2> 1551203 WARN  (qtp1502231331-15160) [    ] o.a.s.h.a.CollectionsHandler Force leader attempt 6. Waiting 5 secs for an active leader. State of the slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "base_url":"http://127.0.0.1:34923/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:34923_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t1",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "leader":"true",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "base_url":"http://127.0.0.1:46627/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:46627_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t2",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "base_url":"http://127.0.0.1:40835/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:40835_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t3",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"}}}
   [junit4]   2> 1556203 WARN  (qtp1502231331-15160) [    ] o.a.s.h.a.CollectionsHandler Force leader attempt 7. Waiting 5 secs for an active leader. State of the slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "base_url":"http://127.0.0.1:34923/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:34923_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t1",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "leader":"true",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "base_url":"http://127.0.0.1:46627/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:46627_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t2",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "base_url":"http://127.0.0.1:40835/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:40835_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t3",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"}}}
   [junit4]   2> 1561203 WARN  (qtp1502231331-15160) [    ] o.a.s.h.a.CollectionsHandler Force leader attempt 8. Waiting 5 secs for an active leader. State of the slice: shard1:{
   [junit4]   2>   "range":"80000000-7fffffff",
   [junit4]   2>   "state":"active",
   [junit4]   2>   "replicas":{
   [junit4]   2>     "core_node4":{
   [junit4]   2>       "base_url":"http://127.0.0.1:34923/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:34923_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t1",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "leader":"true",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node5":{
   [junit4]   2>       "base_url":"http://127.0.0.1:46627/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:46627_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t2",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"},
   [junit4]   2>     "core_node6":{
   [junit4]   2>       "base_url":"http://127.0.0.1:40835/ub/h",
   [junit4]   2>       "node_name":"127.0.0.1:40835_ub%2Fh",
   [junit4]   2>       "core":"forceleader_last_published_shard1_replica_t3",
   [junit4]   2>       "state":"down",
   [junit4]   2>       "type":"TLOG"}}}
   [ju

[...truncated too long message...]

d.LeaderElector.access$200(LeaderElector.java:56)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1566220 WARN  (zkCallback-3688-thread-1) [    ] o.a.s.c.LeaderElector 
   [junit4]   2> org.apache.solr.common.SolrException: SolrCore not found:forceleader_last_published_shard1_replica_t3 in [collection1_shard2_replica_t45]
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:297)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1566924 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[96DE1B3AD690F101]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testLastPublishedStateIsActive
   [junit4]   2> 1568434 WARN  (zkCallback-3664-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1569945 WARN  (zkCallback-3676-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1569961 WARN  (zkCallback-3682-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1570254 WARN  (indexFetcher-5681-thread-1) [    ] o.a.s.h.ReplicationHandler I was asked to replicate but CoreContainer is shutting down
   [junit4]   2> 1570946 WARN  (zkCallback-3688-thread-1) [    ] o.a.s.c.SyncStrategy Closed, skipping sync up.
   [junit4]   2> 1571467 WARN  (zkCallback-3688-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1571469 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[96DE1B3AD690F101]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1576518 WARN  (Thread-3122) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 	3	/solr/collections/forceleader_last_published/state.json
   [junit4]   2> 	3	/solr/collections/collection1/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	4	/solr/overseer/queue
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 1576519 WARN  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.SocketProxy Closing 5 connections to: http://127.0.0.1:34923/ub/h, target: http://127.0.0.1:42367/ub/h
   [junit4]   2> 1576519 WARN  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.SocketProxy Closing 4 connections to: http://127.0.0.1:40835/ub/h, target: http://127.0.0.1:35933/ub/h
   [junit4]   2> 1576519 WARN  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.SocketProxy Closing 3 connections to: http://127.0.0.1:36607/ub/h, target: http://127.0.0.1:43505/ub/h
   [junit4]   2> 1576519 WARN  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[96DE1B3AD690F101]) [    ] o.a.s.c.SocketProxy Closing 7 connections to: http://127.0.0.1:46627/ub/h, target: http://127.0.0.1:44391/ub/h
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_96DE1B3AD690F101-001
   [junit4]   2> NOTE: test params are: codec=FastCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=FAST, chunkSize=975, maxDocsPerChunk=9, blockSize=1), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=FAST, chunkSize=975, blockSize=1)), sim=RandomSimilarity(queryNorm=true): {}, locale=sr-Latn-ME, timezone=Canada/Saskatchewan
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 9 (64-bit)/cpus=8,threads=1,free=231627864,total=527958016
   [junit4]   2> NOTE: All tests run in this JVM: [FileUtilsTest, ExitableDirectoryReaderTest, CSVRequestHandlerTest, TestLegacyFieldReuse, JsonLoaderTest, AlternateDirectoryTest, DistributedFacetPivotWhiteBoxTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, AtomicUpdatesTest, DirectSolrSpellCheckerTest, CoreAdminHandlerTest, ClusterStateUpdateTest, LeaderInitiatedRecoveryOnCommitTest, HdfsLockFactoryTest, TestPullReplica, TestDistributedGrouping, TestFreeTextSuggestions, TestLeaderInitiatedRecoveryThread, TestRandomRequestDistribution, SolrCloudExampleTest, TestComplexPhraseLeadingWildcard, TestCoreContainer, BlockJoinFacetDistribTest, TestBM25SimilarityFactory, TestSubQueryTransformerDistrib, ConnectionReuseTest, TestSweetSpotSimilarityFactory, RemoteQueryErrorTest, TestCloudManagedSchema, HdfsChaosMonkeySafeLeaderTest, TestTrieFacet, DistributedIntervalFacetingTest, TestRTGBase, TestGraphMLResponseWriter, TestSolrConfigHandlerConcurrent, V2StandaloneTest, MetricsConfigTest, ZkSolrClientTest, HighlighterTest, DOMUtilTest, TestSimpleTrackingShardHandler, TestFieldResource, TestInfoStreamLogging, TestCursorMarkWithoutUniqueKey, CurrencyFieldTypeTest, MissingSegmentRecoveryTest, TestCloudDeleteByQuery, HLLSerializationTest, SolrCmdDistributorTest, SystemInfoHandlerTest, JSONWriterTest, IndexSchemaRuntimeFieldTest, TestChildDocTransformer, ZkFailoverTest, VersionInfoTest, ChaosMonkeySafeLeaderTest, TestSolrIndexConfig, HdfsBasicDistributedZk2Test, TestSegmentSorting, TestSQLHandler, TestSolrCloudWithHadoopAuthPlugin, OpenCloseCoreStressTest, TestCustomDocTransformer, TestConfigSetProperties, ScriptEngineTest, TestPayloadScoreQParserPlugin, BlockDirectoryTest, TestSchemaNameResource, TestPostingsSolrHighlighter, TestCustomStream, LoggingHandlerTest, HdfsRecoverLeaseTest, DocValuesTest, MetricUtilsTest, AddBlockUpdateTest, BasicFunctionalityTest, CollectionsAPIDistributedZkTest, DistributedMLTComponentTest, TestReloadDeadlock, TestRawResponseWriter, SOLR749Test, ReplicaListTransformerTest, TestFiltering, TestNoOpRegenerator, HdfsUnloadDistributedZkTest, SolrMetricReporterTest, ConnectionManagerTest, MoveReplicaTest, TestSolrCLIRunExample, PropertiesRequestHandlerTest, TestPerFieldSimilarity, TestRestManager, ResponseHeaderTest, TestUnifiedSolrHighlighter, UpdateRequestProcessorFactoryTest, NoCacheHeaderTest, ConfigureRecoveryStrategyTest, TestFieldSortValues, TestCloudSearcherWarming, TestAtomicUpdateErrorCases, SolrSlf4jReporterTest, LukeRequestHandlerTest, AnalyticsMergeStrategyTest, TestMaxScoreQueryParser, TestExactSharedStatsCache, TestDistribDocBasedVersion, TestConfigSetsAPIZkFailure, TestReplicationHandlerBackup, BlobRepositoryCloudTest, TestConfigsApi, SharedFSAutoReplicaFailoverUtilsTest, HdfsSyncSliceTest, TestCoreDiscovery, TestAnalyzeInfixSuggestions, TestBackupRepositoryFactory, CloudMLTQParserTest, TestHashQParserPlugin, TestHdfsCloudBackupRestore, TestDFISimilarityFactory, OverseerTest, RecoveryZkTest, TestRandomFaceting, TestZkChroot, ZkCLITest, TestFaceting, TestRecovery, ZkControllerTest, TestJoin, TestSolr4Spatial, StatsComponentTest, QueryElevationComponentTest, BadIndexSchemaTest, ConvertedLegacyTest, SoftAutoCommitTest, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, ActionThrottleTest, AssignBackwardCompatibilityTest, CleanupOldIndexTest, CollectionStateFormat2Test, CollectionsAPIAsyncDistributedZkTest, DeleteLastCustomShardedReplicaTest, DeleteShardTest, DistribCursorPagingTest, ForceLeaderTest]
   [junit4] Completed [522/732 (3!)] on J1 in 103.83s, 3 tests, 1 failure, 1 skipped <<< FAILURES!

[...truncated 37234 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20378 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20378/
Java: 64bit/jdk1.8.0_144 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Doc with id=1 not found in http://127.0.0.1:43751/pr_ndj/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:43751/pr_ndj/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([7FA95BAA362F4535:F7FD647098D328CD]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12487 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_7FA95BAA362F4535-001/init-core-data-001
   [junit4]   2> 2302594 WARN  (SUITE-HttpPartitionTest-seed#[7FA95BAA362F4535]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
   [junit4]   2> 2302598 ERROR (Thread-5941) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2302786 ERROR (TEST-HttpPartitionTest.test-seed#[7FA95BAA362F4535]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2304128 WARN  (qtp856842535-18990) [n:127.0.0.1:43751_pr_ndj c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2305323 WARN  (OverseerThreadFactory-4870-thread-2-processing-n:127.0.0.1:43751_pr_ndj) [n:127.0.0.1:43751_pr_ndj    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 2305600 ERROR (TEST-HttpPartitionTest.test-seed#[7FA95BAA362F4535]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2306785 WARN  (qtp841778907-19042) [n:127.0.0.1:37813_pr_ndj c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2307036 ERROR (TEST-HttpPartitionTest.test-seed#[7FA95BAA362F4535]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2308242 WARN  (qtp1630833433-19074) [n:127.0.0.1:33871_pr_ndj c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2308481 ERROR (TEST-HttpPartitionTest.test-seed#[7FA95BAA362F4535]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2309685 WARN  (qtp215474336-19106) [n:127.0.0.1:34013_pr_ndj c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2314976 WARN  (qtp856842535-18989) [n:127.0.0.1:43751_pr_ndj c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica_t1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2314976 WARN  (qtp1630833433-19075) [n:127.0.0.1:33871_pr_ndj c:c8n_crud_1x2 s:shard1  x:c8n_crud_1x2_shard1_replica_t2] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2317045 WARN  (zkCallback-1659-thread-2-processing-n:127.0.0.1:43751_pr_ndj) [n:127.0.0.1:43751_pr_ndj    ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
   [junit4]   2> 2319115 WARN  (qtp1630833433-19071) [n:127.0.0.1:33871_pr_ndj c:collMinRf_1x3 s:shard1  x:collMinRf_1x3_shard1_replica_t1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2319116 WARN  (qtp215474336-19107) [n:127.0.0.1:34013_pr_ndj c:collMinRf_1x3 s:shard1  x:collMinRf_1x3_shard1_replica_t2] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2319128 WARN  (qtp856842535-18996) [n:127.0.0.1:43751_pr_ndj c:collMinRf_1x3 s:shard1  x:collMinRf_1x3_shard1_replica_t3] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2321223 WARN  (TEST-HttpPartitionTest.test-seed#[7FA95BAA362F4535]) [    ] o.a.s.c.SocketProxy Closing 5 connections to: http://127.0.0.1:34013/pr_ndj, target: http://127.0.0.1:33477/pr_ndj
   [junit4]   2> 2321272 ERROR (updateExecutor-1674-thread-1-processing-http:////127.0.0.1:34013//pr_ndj//collMinRf_1x3_shard1_replica_t2 x:collMinRf_1x3_shard1_replica_t1 r:core_node4 n:127.0.0.1:33871_pr_ndj s:shard1 c:collMinRf_1x3) [n:127.0.0.1:33871_pr_ndj c:collMinRf_1x3 s:shard1 r:core_node4 x:collMinRf_1x3_shard1_replica_t1] o.a.s.u.ErrorReportingConcurrentUpdateSolrClient error
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2321273 WARN  (qtp1630833433-19069) [n:127.0.0.1:33871_pr_ndj c:collMinRf_1x3 s:shard1 r:core_node4 x:collMinRf_1x3_shard1_replica_t1] o.a.s.u.p.DistributedUpdateProcessor Error sending update to http://127.0.0.1:34013/pr_ndj
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2321273 ERROR (qtp1630833433-19069) [n:127.0.0.1:33871_pr_ndj c:collMinRf_1x3 s:shard1 r:core_node4 x:collMinRf_1x3_shard1_replica_t1] o.a.s.u.p.DistributedUpdateProcessor Setting up to try to start recovery on replica http://127.0.0.1:34013/pr_ndj/collMinRf_1x3_shard1_replica_t2/
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2321277 WARN  (updateExecutor-1674-thread-1-processing-x:collMinRf_1x3_shard1_replica_t1 r:core_node4 http:////127.0.0.1:34013//pr_ndj//collMinRf_1x3_shard1_replica_t2// n:127.0.0.1:33871_pr_ndj s:shard1 c:collMinRf_1x3) [n:127.0.0.1:33871_pr_ndj c:collMinRf_1x3 s:shard1 r:core_node4 x:collMinRf_1x3_shard1_replica_t1] o.a.s.c.LeaderInitiatedRecoveryThread Leader is publishing core=collMinRf_1x3_shard1_replica_t2 coreNodeName =core_node6 state=down on behalf of un-reachable replica http://127.0.0.1:34013/pr_ndj/collMinRf_1x3_shard1_replica_t2/
   [junit4]   2> 2321279 ERROR (updateExecutor-1674-thread-1-processing-x:collMinRf_1x3_shard1_replica_t1 r:core_node4 http:////127.0.0.1:34013//pr_ndj//collMinRf_1x3_shard1_replica_t2// n:127.0.0.1:33871_pr_ndj s:shard1 c:collMinRf_1x3) [n:127.0.0.1:33871_pr_ndj c:collMinRf_1x3 s:shard1 r:core_node4 x:collMinRf_1x3_shard1_replica_t1] o.a.s.c.LeaderInitiatedRecoveryThread http://127.0.0.1:34013/pr_ndj: Could not tell a replica to recover:org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:34013/pr_ndj
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:634)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderInitiatedRecoveryThread.sendRecoveryCommandWithRetry(LeaderInitiatedRecoveryThread.java:209)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderInitiatedRecoveryThread.run(LeaderInitiatedRecoveryThread.java:95)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:34013 [/127.0.0.1] failed: Connection refused (Connection refused)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
   [junit4]   2> 	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:353)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:380)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:526)
   [junit4]   2> 	... 10 more
   [junit4]   2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
   [junit4]   2> 	at java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:350)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:206)
   [junit4]   2> 	at java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:188)
   [junit4]   2> 	at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:392)
   [junit4]   2> 	at java.net.Socket.connect(Socket.java:589)
   [junit4]   2> 	at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:74)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:134)
   [junit4]   2> 	... 20 more
   [junit4]   2> 
   [junit4]   2> 2326279 WARN  (updateExecutor-1674-thread-1-processing-x:collMinRf_1x3_shard1_replica_t1 r:core_node4 http:////127.0.0.1:34013//pr_ndj//collMinRf_1x3_shard1_replica_t2// n:127.0.0.1:33871_pr_ndj s:shard1 c:collMinRf_1x3) [n:127.0.0.1:33871_pr_ndj c:collMinRf_1x3 s:shard1 r:core_node4 x:collMinRf_1x3_shard1_replica_t1] o.a.s.c.LeaderInitiatedRecoveryThread Asking core=collMinRf_1x3_shard1_replica_t2 coreNodeName=core_node6 on http://127.0.0.1:34013/pr_ndj to recover; unsuccessful after 2 of 120 attempts so far ...
   [junit4]   2> 2328103 WARN  (zkCallback-1659-thread-1-processing-n:127.0.0.1:43751_pr_ndj) [n:127.0.0.1:43751_pr_ndj    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2329615 WARN  (zkCallback-1671-thread-2-processing-n:127.0.0.1:37813_pr_ndj) [n:127.0.0.1:37813_pr_ndj    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2331149 WARN  (zkCallback-1677-thread-2-processing-n:127.0.0.1:33871_pr_ndj) [n:127.0.0.1:33871_pr_ndj    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2331179 ERROR (indexFetcher-4946-thread-1) [n:127.0.0.1:34013_pr_ndj c:collMinRf_1x3 s:shard1 r:core_node6 x:collMinRf_1x3_shard1_replica_t2] o.a.s.h.ReplicationHandler Index fetch failed :org.apache.solr.common.SolrException: No registered leader was found after waiting for 4000ms , collection: collMinRf_1x3 slice: shard1
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:758)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:744)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.getLeaderReplica(IndexFetcher.java:667)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:332)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:419)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(ReplicationHandler.java:1183)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 2332150 WARN  (zkCallback-1683-thread-4-processing-n:127.0.0.1:34013_pr_ndj) [n:127.0.0.1:34013_pr_ndj c:collMinRf_1x3 s:shard1 r:core_node6 x:collMinRf_1x3_shard1_replica_t2] o.a.s.c.SyncStrategy Closed, skipping sync up.
   [junit4]   2> 2332663 WARN  (zkCallback-1683-thread-2-processing-n:127.0.0.1:34013_pr_ndj) [n:127.0.0.1:34013_pr_ndj    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2332664 ERROR (TEST-HttpPartitionTest.test-seed#[7FA95BAA362F4535]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2337703 WARN  (Thread-5941) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 	3	/solr/collections/collection1/state.json
   [junit4]   2> 	3	/solr/collections/collMinRf_1x3/state.json
   [junit4]   2> 	2	/solr/collections/c8n_crud_1x2/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	3	/solr/overseer/queue
   [junit4]   2> 	3	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 2337703 WARN  (TEST-HttpPartitionTest.test-seed#[7FA95BAA362F4535]) [    ] o.a.s.c.SocketProxy Closing 9 connections to: http://127.0.0.1:37813/pr_ndj, target: http://127.0.0.1:44351/pr_ndj
   [junit4]   2> 2337704 WARN  (TEST-HttpPartitionTest.test-seed#[7FA95BAA362F4535]) [    ] o.a.s.c.SocketProxy Closing 6 connections to: http://127.0.0.1:43751/pr_ndj, target: http://127.0.0.1:34179/pr_ndj
   [junit4]   2> 2337704 WARN  (TEST-HttpPartitionTest.test-seed#[7FA95BAA362F4535]) [    ] o.a.s.c.SocketProxy Closing 2 connections to: http://127.0.0.1:34013/pr_ndj, target: http://127.0.0.1:33477/pr_ndj
   [junit4]   2> 2337704 WARN  (TEST-HttpPartitionTest.test-seed#[7FA95BAA362F4535]) [    ] o.a.s.c.SocketProxy Closing 11 connections to: http://127.0.0.1:33871/pr_ndj, target: http://127.0.0.1:46687/pr_ndj
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpPartitionTest -Dtests.method=test -Dtests.seed=7FA95BAA362F4535 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-GB -Dtests.timezone=US/Samoa -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 35.1s J0 | HttpPartitionTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:43751/pr_ndj/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([7FA95BAA362F4535:F7FD647098D328CD]:0)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_7FA95BAA362F4535-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {multiDefault=Lucene50(blocksize=128), a_t=Lucene50(blocksize=128), id=FSTOrd50, text=PostingsFormat(name=Asserting)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Lucene70), intDvoDefault=DocValuesFormat(name=Asserting), timestamp=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=862, maxMBSortInHeap=7.943200911350646, sim=RandomSimilarity(queryNorm=true): {}, locale=en-GB, timezone=US/Samoa
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=127262624,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestImpersonationWithHadoopAuth, TestHdfsUpdateLog, TestSolrCloudWithSecureImpersonation, TestRecoveryHdfs, TestPolicyCloud, CursorPagingTest, TestLeaderElectionZkExpiry, TestCollationFieldDocValues, TestEmbeddedSolrServerAdminHandler, BasicDistributedZkTest, OutputWriterTest, NodeMutatorTest, AsyncCallRequestStatusResponseTest, HighlighterMaxOffsetTest, TestStressLucene, ConfigSetsAPITest, CdcrVersionReplicationTest, TestRandomCollapseQParserPlugin, DistributedFacetPivotSmallTest, AliasIntegrationTest, TestManagedResourceStorage, ZkNodePropsTest, TestSolr4Spatial, DistributedFacetPivotLargeTest, TestWordDelimiterFilterFactory, OverseerCollectionConfigSetProcessorTest, TestBinaryField, TestLockTree, SpellingQueryConverterTest, TestQuerySenderNoQuery, MigrateRouteKeyTest, TestXmlQParserPlugin, TestReplicaProperties, TestComponentsName, TestSubQueryTransformerCrossCore, TestCorePropertiesReload, TestIBSimilarityFactory, TestWriterPerf, SearchHandlerTest, TestTolerantUpdateProcessorRandomCloud, TestUniqueKeyFieldResource, SpatialHeatmapFacetsTest, TestDistributedSearch, TestBadConfig, TestCrossCoreJoin, PKIAuthenticationIntegrationTest, TestSolrConfigHandlerCloud, PeerSyncTest, RAMDirectoryFactoryTest, IndexBasedSpellCheckerTest, TestBulkSchemaConcurrent, InfixSuggestersTest, FieldAnalysisRequestHandlerTest, TestAuthenticationFramework, DistributedQueryComponentOptimizationTest, TestExtendedDismaxParser, SolrMetricManagerTest, HdfsDirectoryTest, TestCollectionAPI, TestLMDirichletSimilarityFactory, TestHdfsBackupRestoreCore, ExternalFileFieldSortTest, SolrPluginUtilsTest, TestRangeQuery, ZkStateWriterTest, TestRemoteStreaming, TestHighlightDedupGrouping, CachingDirectoryFactoryTest, TestManagedSynonymGraphFilterFactory, PreAnalyzedFieldManagedSchemaCloudTest, TestDeleteCollectionOnDownNodes, TestConfig, TestFunctionQuery, TestPivotHelperCode, TestPerFieldSimilarityWithDefaultOverride, TestCSVResponseWriter, CoreAdminRequestStatusTest, CollectionsAPIAsyncDistributedZkTest, TestLegacyTerms, UpdateParamsTest, DocExpirationUpdateProcessorFactoryTest, TestFieldCollectionResource, TestDocSet, VMParamsZkACLAndCredentialsProvidersTest, StressHdfsTest, MBeansHandlerTest, TestMacros, SolrCLIZkUtilsTest, TestCollectionAPIs, TestMinMaxOnMultiValuedField, SolrShardReporterTest, OpenExchangeRatesOrgProviderTest, DistributedDebugComponentTest, TestPHPSerializedResponseWriter, UtilsToolTest, SpellCheckCollatorTest, HdfsChaosMonkeyNothingIsSafeTest, RequestHandlersTest, TestOmitPositions, TestUseDocValuesAsStored2, DeleteStatusTest, TestSchemaManager, ReplicationFactorTest, BlockCacheTest, CustomCollectionTest, UpdateLogTest, BigEndianAscendingWordSerializerTest, JvmMetricsTest, SolrCoreTest, TestSimpleTextCodec, SolrIndexConfigTest, HdfsTlogReplayBufferedWhileIndexingTest, RankQueryTest, TestImplicitCoreProperties, TestCloudJSONFacetJoinDomain, HttpPartitionTest]
   [junit4] Completed [527/732 (1!)] on J0 in 35.13s, 1 test, 1 failure <<< FAILURES!

[...truncated 44022 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20377 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20377/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping

Error Message:
Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.

Stack Trace:
java.lang.AssertionError: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
	at __randomizedtesting.SeedInfo.seed([EEFC03F9D0E86AE5:9F18FD2FA6034D29]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
count1=7, count2=7 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: count1=7, count2=7 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([EEFC03F9D0E86AE5:B1182ECEBBE4F9A0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:90)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11413 lines...]
   [junit4] Suite: org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_EEFC03F9D0E86AE5-001/init-core-data-001
   [junit4]   2> 692777 WARN  (SUITE-UpdateRequestProcessorFactoryTest-seed#[EEFC03F9D0E86AE5]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=11 numCloses=11
   [junit4]   2> 693146 WARN  (coreLoadExecutor-2342-thread-1) [    x:collection1] o.a.s.c.RequestHandlers no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 693148 WARN  (coreLoadExecutor-2342-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UpdateRequestProcessorFactoryTest -Dtests.method=testUpdateDistribChainSkipping -Dtests.seed=EEFC03F9D0E86AE5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-PH -Dtests.timezone=Asia/Baku -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 0.00s J1 | UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EEFC03F9D0E86AE5:9F18FD2FA6034D29]:0)
   [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_EEFC03F9D0E86AE5-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1814, maxMBSortInHeap=6.906478122863362, sim=RandomSimilarity(queryNorm=true): {}, locale=en-PH, timezone=Asia/Baku
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=77564488,total=303427584
   [junit4]   2> NOTE: All tests run in this JVM: [TestCloudPivotFacet, TestBM25SimilarityFactory, TestFiltering, TestLRUCache, StatsReloadRaceTest, TestPayloadScoreQParserPlugin, BasicAuthIntegrationTest, TestCustomDocTransformer, V2StandaloneTest, AssignBackwardCompatibilityTest, TestNumericTerms32, DisMaxRequestHandlerTest, TestCollectionsAPIViaSolrCloudCluster, TestSQLHandler, HdfsLockFactoryTest, CoreMergeIndexesAdminHandlerTest, SubstringBytesRefFilterTest, TestUpdate, AnalysisAfterCoreReloadTest, ShardRoutingCustomTest, ConvertedLegacyTest, DistributedQueueTest, SpellCheckComponentTest, TestEmbeddedSolrServerConstructors, SchemaVersionSpecificBehaviorTest, EnumFieldTest, TestAtomicUpdateErrorCases, TestDFISimilarityFactory, TestDocBasedVersionConstraints, TestAuthorizationFramework, CollectionsAPIDistributedZkTest, AddBlockUpdateTest, TestSha256AuthenticationProvider, LeaderElectionContextKeyTest, TermVectorComponentTest, WrapperMergePolicyFactoryTest, MetricsConfigTest, TestElisionMultitermQuery, LeaderInitiatedRecoveryOnCommitTest, TestSchemaNameResource, TestMultiValuedNumericRangeQuery, OpenCloseCoreStressTest, TestDistributedGrouping, AtomicUpdatesTest, CloudMLTQParserTest, TestTrackingShardHandlerFactory, TestSolrCLIRunExample, TestCustomStream, SuggestComponentContextFilterQueryTest, TestMiniSolrCloudClusterSSL, TestUnifiedSolrHighlighter, TestMaxTokenLenTokenizer, TestReloadAndDeleteDocs, AnalyticsMergeStrategyTest, TestExpandComponent, HLLSerializationTest, DocValuesTest, UpdateRequestProcessorFactoryTest]
   [junit4] Completed [200/732 (1!)] on J1 in 0.41s, 3 tests, 1 failure <<< FAILURES!

[...truncated 216 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_EEFC03F9D0E86AE5-001/init-core-data-001
   [junit4]   2> 831819 WARN  (SUITE-SolrSlf4jReporterTest-seed#[EEFC03F9D0E86AE5]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=EEFC03F9D0E86AE5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=he -Dtests.timezone=Indian/Mayotte -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 8.05s J1 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: count1=7, count2=7 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EEFC03F9D0E86AE5:B1182ECEBBE4F9A0]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:90)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_EEFC03F9D0E86AE5-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=true): {}, locale=he, timezone=Indian/Mayotte
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=57792280,total=303558656
   [junit4]   2> NOTE: All tests run in this JVM: [TestCloudPivotFacet, TestBM25SimilarityFactory, TestFiltering, TestLRUCache, StatsReloadRaceTest, TestPayloadScoreQParserPlugin, BasicAuthIntegrationTest, TestCustomDocTransformer, V2StandaloneTest, AssignBackwardCompatibilityTest, TestNumericTerms32, DisMaxRequestHandlerTest, TestCollectionsAPIViaSolrCloudCluster, TestSQLHandler, HdfsLockFactoryTest, CoreMergeIndexesAdminHandlerTest, SubstringBytesRefFilterTest, TestUpdate, AnalysisAfterCoreReloadTest, ShardRoutingCustomTest, ConvertedLegacyTest, DistributedQueueTest, SpellCheckComponentTest, TestEmbeddedSolrServerConstructors, SchemaVersionSpecificBehaviorTest, EnumFieldTest, TestAtomicUpdateErrorCases, TestDFISimilarityFactory, TestDocBasedVersionConstraints, TestAuthorizationFramework, CollectionsAPIDistributedZkTest, AddBlockUpdateTest, TestSha256AuthenticationProvider, LeaderElectionContextKeyTest, TermVectorComponentTest, WrapperMergePolicyFactoryTest, MetricsConfigTest, TestElisionMultitermQuery, LeaderInitiatedRecoveryOnCommitTest, TestSchemaNameResource, TestMultiValuedNumericRangeQuery, OpenCloseCoreStressTest, TestDistributedGrouping, AtomicUpdatesTest, CloudMLTQParserTest, TestTrackingShardHandlerFactory, TestSolrCLIRunExample, TestCustomStream, SuggestComponentContextFilterQueryTest, TestMiniSolrCloudClusterSSL, TestUnifiedSolrHighlighter, TestMaxTokenLenTokenizer, TestReloadAndDeleteDocs, AnalyticsMergeStrategyTest, TestExpandComponent, HLLSerializationTest, DocValuesTest, UpdateRequestProcessorFactoryTest, TestSolrConfigHandler, LukeRequestHandlerTest, TestConfigsApi, StatelessScriptUpdateProcessorFactoryTest, ConfigureRecoveryStrategyTest, TestMaxScoreQueryParser, ConnectionManagerTest, ConnectionReuseTest, TestHalfAndHalfDocValues, HdfsUnloadDistributedZkTest, ZkControllerTest, TestChildDocTransformer, ReplicaListTransformerTest, TolerantUpdateProcessorTest, TestSubQueryTransformerDistrib, QueryParsingTest, MetricUtilsTest, OverseerModifyCollectionTest, SolrMetricReporterTest, TestValueSourceCache, ScriptEngineTest, DistanceFunctionTest, TestAnalyzeInfixSuggestions, TestFastLRUCache, ResourceLoaderTest, ZkFailoverTest, NoCacheHeaderTest, TestExactSharedStatsCache, TestGraphMLResponseWriter, DistributedFacetPivotLongTailTest, TestRestManager, SolrSlf4jReporterTest]
   [junit4] Completed [270/732 (2!)] on J1 in 8.10s, 1 test, 1 failure <<< FAILURES!

[...truncated 40955 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20376 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20376/
Java: 64bit/jdk1.8.0_144 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

1 tests failed.
FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
count1=7, count2=7 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: count1=7, count2=7 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([CEC0AA9A433E04B0:912487AD283297F5]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:90)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12825 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_CEC0AA9A433E04B0-001/init-core-data-001
   [junit4]   2> 2479640 WARN  (SUITE-SolrSlf4jReporterTest-seed#[CEC0AA9A433E04B0]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=8 numCloses=8
   [junit4]   2> 2479640 INFO  (SUITE-SolrSlf4jReporterTest-seed#[CEC0AA9A433E04B0]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2479641 INFO  (SUITE-SolrSlf4jReporterTest-seed#[CEC0AA9A433E04B0]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 2479641 INFO  (SUITE-SolrSlf4jReporterTest-seed#[CEC0AA9A433E04B0]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2479649 INFO  (TEST-SolrSlf4jReporterTest.testReporter-seed#[CEC0AA9A433E04B0]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testReporter
   [junit4]   2> 2486692 INFO  (TEST-SolrSlf4jReporterTest.testReporter-seed#[CEC0AA9A433E04B0]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testReporter
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=CEC0AA9A433E04B0 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ja-JP-u-ca-japanese-x-lvariant-JP -Dtests.timezone=Africa/Abidjan -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 7.05s J1 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: count1=7, count2=7 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([CEC0AA9A433E04B0:912487AD283297F5]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:90)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 2486694 INFO  (SUITE-SolrSlf4jReporterTest-seed#[CEC0AA9A433E04B0]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_CEC0AA9A433E04B0-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=true): {}, locale=ja-JP-u-ca-japanese-x-lvariant-JP, timezone=Africa/Abidjan
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=267838072,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [BasicFunctionalityTest, TestCustomStream, CleanupOldIndexTest, GraphQueryTest, TestAnalyzeInfixSuggestions, EnumFieldTest, TestExactSharedStatsCache, ClassificationUpdateProcessorTest, TestPartialUpdateDeduplication, HdfsBasicDistributedZk2Test, TestFieldCacheVsDocValues, TestSQLHandler, RestartWhileUpdatingTest, LeaderElectionContextKeyTest, TestLeaderInitiatedRecoveryThread, TestSolrConfigHandlerConcurrent, DOMUtilTest, PropertiesRequestHandlerTest, TestCloudDeleteByQuery, JSONWriterTest, DataDrivenBlockJoinTest, TestNumericTerms32, DirectSolrConnectionTest, TestSchemaNameResource, BlockJoinFacetDistribTest, PrimUtilsTest, TestSolrJ, LukeRequestHandlerTest, QueryParsingTest, AtomicUpdatesTest, DocValuesMultiTest, TestFieldResource, TestStressCloudBlindAtomicUpdates, TestManagedSchemaThreadSafety, SortSpecParsingTest, TestElisionMultitermQuery, TermVectorComponentTest, MissingSegmentRecoveryTest, IndexSchemaRuntimeFieldTest, ZkSolrClientTest, TestXIncludeConfig, HdfsUnloadDistributedZkTest, TestJsonFacetRefinement, MetricUtilsTest, ImplicitSnitchTest, HdfsChaosMonkeySafeLeaderTest, TestCharFilters, ExitableDirectoryReaderTest, SolrGraphiteReporterTest, SolrCmdDistributorTest, TestCoreContainer, TestPayloadScoreQParserPlugin, TestFieldCacheReopen, TestReloadAndDeleteDocs, MoveReplicaTest, TestSolrFieldCacheBean, TestRawResponseWriter, TestHalfAndHalfDocValues, TestValueSourceCache, TestStreamBody, TestSweetSpotSimilarityFactory, TestHashPartitioner, CdcrReplicationHandlerTest, TestSimpleTrackingShardHandler, LeaderInitiatedRecoveryOnCommitTest, TestSolrCoreSnapshots, SpatialFilterTest, TestDFISimilarityFactory, ConnectionReuseTest, DistributedIntervalFacetingTest, TestChildDocTransformer, ZkControllerTest, TestMultiValuedNumericRangeQuery, TestGraphMLResponseWriter, CollectionsAPIDistributedZkTest, CoreMergeIndexesAdminHandlerTest, TestTrackingShardHandlerFactory, CloudMLTQParserTest, TestSolrCloudWithDelegationTokens, BaseCdcrDistributedZkTest, TestScoreJoinQPNoScore, ForceLeaderTest, SpellCheckComponentTest, TestComplexPhraseLeadingWildcard, SolrMetricReporterTest, TestFastLRUCache, DistributedFacetPivotWhiteBoxTest, TestOrdValues, SOLR749Test, TestSmileRequest, BadComponentTest, TlogReplayBufferedWhileIndexingTest, OutOfBoxZkACLAndCredentialsProvidersTest, ScriptEngineTest, TestPerFieldSimilarity, TestSubQueryTransformerDistrib, CSVRequestHandlerTest, DistributedTermsComponentTest, MoreLikeThisHandlerTest, TestCursorMarkWithoutUniqueKey, ReplicaListTransformerTest, TestBM25SimilarityFactory, CollectionStateFormat2Test, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestReplicationHandlerBackup, SubstringBytesRefFilterTest, TestRestManager, TestCloudSearcherWarming, DeleteInactiveReplicaTest, DistributedSuggestComponentTest, SliceStateTest, ChaosMonkeySafeLeaderTest, TestCloudManagedSchema, ShardRoutingCustomTest, TestRTGBase, StatsReloadRaceTest, SystemInfoHandlerTest, TestSegmentSorting, TestDocBasedVersionConstraints, TestMaxScoreQueryParser, IgnoreCommitOptimizeUpdateProcessorFactoryTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, BasicZkTest, FullSolrCloudDistribCmdsTest, TestZkChroot, ZkCLITest, AutoCommitTest, DistributedSpellCheckComponentTest, TestRealTimeGet, TestReload, TestStressVersions, HardAutoCommitTest, SimpleFacetsTest, TestSolr4Spatial, ConvertedLegacyTest, TestFiltering, ShowFileRequestHandlerTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, TestExtendedDismaxParser, CoreAdminHandlerTest, DocValuesTest, SuggesterTSTTest, SuggesterTest, TestStressLucene, SuggesterWFSTTest, TestCSVLoader, NoCacheHeaderTest, SchemaVersionSpecificBehaviorTest, TestUpdate, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, TestRemoteStreaming, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoBeanTest, CacheHeaderTest, DisMaxRequestHandlerTest, TestQueryUtils, DirectSolrSpellCheckerTest, TestQueryTypes, TestOmitPositions, FileBasedSpellCheckerTest, RequestHandlersTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, RequiredFieldsTest, LoggingHandlerTest, IndexSchemaTest, TestJmxIntegration, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, MBeansHandlerTest, HighlighterConfigTest, TestQuerySenderListener, AlternateDirectoryTest, TestSolrIndexConfig, CopyFieldTest, ResponseLogComponentTest, TestStressRecovery, TestSystemIdResolver, DateFieldTest, SpellingQueryConverterTest, TestLRUCache, TestDocumentBuilder, UUIDFieldTest, FileUtilsTest, DistributedMLTComponentTest, CursorPagingTest, SolrTestCaseJ4Test, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, AssignBackwardCompatibilityTest, AssignTest, ChaosMonkeySafeLeaderWithPullReplicasTest, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, ConfigSetsAPITest, ConnectionManagerTest, CustomCollectionTest, DistribCursorPagingTest, DistributedQueueTest, HttpPartitionTest, PeerSyncReplicationTest, RemoteQueryErrorTest, RollingRestartTest, SolrCLIZkUtilsTest, SolrCloudExampleTest, TestCloudRecovery, TestConfigSetsAPIExclusivity, TestConfigSetsAPIZkFailure, TestCryptoKeys, TestDownShardTolerantSearch, TestExclusionRuleCollectionAccess, TestHdfsCloudBackupRestore, TestPrepRecovery, TestRandomRequestDistribution, TestRequestForwarding, TestShortCircuitedRequests, TestSolrCloudWithSecureImpersonation, TestTolerantUpdateProcessorCloud, ZkFailoverTest, HdfsRestartWhileUpdatingTest, HdfsSyncSliceTest, HdfsWriteToMultipleCollectionsTest, TestClusterStateMutator, RulesTest, TestConfigSetProperties, TestInfoStreamLogging, TestSimpleTextCodec, TestSolrConfigHandler, TestHdfsBackupRestoreCore, DistributedFacetPivotSmallTest, SuggestComponentContextFilterQueryTest, TestUnifiedSolrHighlighter, TestLegacyField, TestLegacyFieldReuse, TestLegacyNumericUtils, TestLegacyTerms, TestNumericRangeQuery32, TestNumericTokenStream, JvmMetricsTest, MetricsConfigTest, SolrCoreMetricManagerTest, SolrJmxReporterCloudTest, SolrSlf4jReporterTest]
   [junit4] Completed [626/732 (1!)] on J1 in 7.09s, 1 test, 1 failure <<< FAILURES!

[...truncated 43698 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20375 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20375/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseParallelGC

5 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.analytics.NoFacetCloudTest

Error Message:
Could not find collection:collection1

Stack Trace:
java.lang.AssertionError: Could not find collection:collection1
	at __randomizedtesting.SeedInfo.seed([4E874E67E30C1AEC]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertNotNull(Assert.java:526)
	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
	at org.apache.solr.analytics.AbstractAnalyticsStatsCloudTest.setupCluster(AbstractAnalyticsStatsCloudTest.java:76)
	at org.apache.solr.analytics.NoFacetCloudTest.populate(NoFacetCloudTest.java:62)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:847)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelExecutorStream

Error Message:
Error from server at https://127.0.0.1:45543/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason: <pre>    Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:45543/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason:
<pre>    Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([A64F71E6FD2F155A:1B5804FFC4032807]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
	at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testParallelExecutorStream(StreamExpressionTest.java:6891)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:45543/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason:
<pre>    Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
	... 1 more


FAILED:  org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader

Error Message:
Doc with id=1 not found in http://127.0.0.1:40511/ge_va/t/forceleader_test_collection due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:40511/ge_va/t/forceleader_test_collection due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([99F0ADBAE0C10765:7F67997AD943FE04]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:556)
	at org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader(ForceLeaderTest.java:142)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.handler.TestSQLHandler.doTest

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([99F0ADBAE0C10765:3EB4151E8D7A14DC]:0)
	at org.apache.solr.handler.TestSQLHandler.testBasicSelect(TestSQLHandler.java:182)
	at org.apache.solr.handler.TestSQLHandler.doTest(TestSQLHandler.java:83)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
count1=6, count2=6 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: count1=6, count2=6 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([99F0ADBAE0C10765:C614808D8BCD9420]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:90)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11780 lines...]
   [junit4] Suite: org.apache.solr.cloud.ForceLeaderTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/init-core-data-001
   [junit4]   2> 971763 INFO  (SUITE-ForceLeaderTest-seed#[99F0ADBAE0C10765]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 971764 INFO  (SUITE-ForceLeaderTest-seed#[99F0ADBAE0C10765]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 971764 INFO  (SUITE-ForceLeaderTest-seed#[99F0ADBAE0C10765]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 971764 INFO  (SUITE-ForceLeaderTest-seed#[99F0ADBAE0C10765]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /ge_va/t
   [junit4]   2> 971766 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 971766 INFO  (Thread-1678) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 971766 INFO  (Thread-1678) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 971768 ERROR (Thread-1678) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 971866 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.ZkTestServer start zk server on port:43349
   [junit4]   2> 971872 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 971872 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 971873 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 971873 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 971874 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 971874 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 971874 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 971875 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 971875 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 971876 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 971876 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 971877 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 971941 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 971943 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@86aec3{/ge_va/t,null,AVAILABLE}
   [junit4]   2> 971944 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@ec5eaa{HTTP/1.1,[http/1.1]}{127.0.0.1:38079}
   [junit4]   2> 971944 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.Server Started @973422ms
   [junit4]   2> 971944 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/tempDir-001/control/data, replicaType=NRT, hostContext=/ge_va/t, hostPort=36149, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/control-001/cores}
   [junit4]   2> 971945 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 971945 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 971945 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 971945 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 971945 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T08:08:09.876Z
   [junit4]   2> 971947 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 971947 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/control-001/solr.xml
   [junit4]   2> 971949 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 971955 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43349/solr
   [junit4]   2> 972001 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 972001 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36149_ge_va%2Ft
   [junit4]   2> 972002 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.Overseer Overseer (id=98548769731182596-127.0.0.1:36149_ge_va%2Ft-n_0000000000) starting
   [junit4]   2> 972006 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36149_ge_va%2Ft
   [junit4]   2> 972007 INFO  (zkCallback-1049-thread-1-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 972102 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 972109 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 972109 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 972110 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/control-001/cores
   [junit4]   2> 972126 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 972126 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43349/solr ready
   [junit4]   2> 972127 INFO  (SocketProxy-Acceptor-36149) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=56980,localport=36149], receiveBufferSize:531000
   [junit4]   2> 972133 INFO  (SocketProxy-Acceptor-36149) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38079,localport=49232], receiveBufferSize=530904
   [junit4]   2> 972137 INFO  (qtp4960878-6758) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:36149_ge_va%252Ft&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 972141 INFO  (OverseerThreadFactory-2869-thread-1-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 972243 INFO  (SocketProxy-Acceptor-36149) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=56984,localport=36149], receiveBufferSize:531000
   [junit4]   2> 972243 INFO  (SocketProxy-Acceptor-36149) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38079,localport=49236], receiveBufferSize=530904
   [junit4]   2> 972244 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 972244 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 972346 INFO  (zkCallback-1049-thread-1-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 973263 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 973273 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 973354 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 973369 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 973370 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 973370 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 973370 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 973372 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=47, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 973374 WARN  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 973415 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 973415 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 973416 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 973416 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 973417 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2643382224025981]
   [junit4]   2> 973417 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1b9d8a6[control_collection_shard1_replica_n1] main]
   [junit4]   2> 973422 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 973422 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 973423 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 973423 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576780317436411904
   [junit4]   2> 973426 INFO  (searcherExecutor-2872-thread-1-processing-n:127.0.0.1:36149_ge_va%2Ft x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@1b9d8a6[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 973427 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 973427 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 973427 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36149/ge_va/t/control_collection_shard1_replica_n1/
   [junit4]   2> 973427 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 973427 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:36149/ge_va/t/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 973427 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 973428 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36149/ge_va/t/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 973530 INFO  (zkCallback-1049-thread-1-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 973579 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 973581 INFO  (qtp4960878-6760) [n:127.0.0.1:36149_ge_va%2Ft c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1336
   [junit4]   2> 973583 INFO  (qtp4960878-6758) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 973683 INFO  (zkCallback-1049-thread-1-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 974142 INFO  (OverseerCollectionConfigSetProcessor-98548769731182596-127.0.0.1:36149_ge_va%2Ft-n_0000000000) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 974584 INFO  (qtp4960878-6758) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:36149_ge_va%252Ft&wt=javabin&version=2} status=0 QTime=2447
   [junit4]   2> 974588 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 974588 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43349/solr ready
   [junit4]   2> 974588 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 974589 INFO  (SocketProxy-Acceptor-36149) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=56990,localport=36149], receiveBufferSize:531000
   [junit4]   2> 974591 INFO  (qtp4960878-6758) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 974593 INFO  (SocketProxy-Acceptor-36149) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38079,localport=49242], receiveBufferSize=530904
   [junit4]   2> 974593 INFO  (OverseerThreadFactory-2869-thread-2-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 974593 WARN  (OverseerThreadFactory-2869-thread-2-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 974795 INFO  (qtp4960878-6758) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 974795 INFO  (qtp4960878-6758) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=204
   [junit4]   2> 974865 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-1-001 of type TLOG
   [junit4]   2> 974865 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 974871 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3fd2ee{/ge_va/t,null,AVAILABLE}
   [junit4]   2> 974872 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@11417ae{HTTP/1.1,[http/1.1]}{127.0.0.1:36739}
   [junit4]   2> 974872 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.Server Started @976349ms
   [junit4]   2> 974872 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/ge_va/t, hostPort=41107, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-1-001/cores}
   [junit4]   2> 974872 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 974872 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 974872 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 974872 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 974872 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T08:08:12.803Z
   [junit4]   2> 974874 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 974874 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-1-001/solr.xml
   [junit4]   2> 974876 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 974878 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43349/solr
   [junit4]   2> 974903 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 974907 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 974908 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41107_ge_va%2Ft
   [junit4]   2> 974909 INFO  (zkCallback-1056-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 974911 INFO  (zkCallback-1049-thread-1-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 974913 INFO  (zkCallback-1061-thread-1-processing-n:127.0.0.1:41107_ge_va%2Ft) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 974993 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 975005 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 975005 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 975007 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-1-001/cores
   [junit4]   2> 975037 INFO  (SocketProxy-Acceptor-41107) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=40450,localport=41107], receiveBufferSize:531000
   [junit4]   2> 975040 INFO  (SocketProxy-Acceptor-41107) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36739,localport=42990], receiveBufferSize=530904
   [junit4]   2> 975041 INFO  (qtp10975815-6806) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:41107_ge_va%252Ft&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 975048 INFO  (OverseerCollectionConfigSetProcessor-98548769731182596-127.0.0.1:36149_ge_va%2Ft-n_0000000000) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 975049 INFO  (OverseerThreadFactory-2869-thread-3-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:41107_ge_va%2Ft for creating new replica
   [junit4]   2> 975050 INFO  (SocketProxy-Acceptor-41107) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=40454,localport=41107], receiveBufferSize:531000
   [junit4]   2> 975053 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 975054 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 975061 INFO  (SocketProxy-Acceptor-41107) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36739,localport=42994], receiveBufferSize=530904
   [junit4]   2> 975160 INFO  (zkCallback-1061-thread-1-processing-n:127.0.0.1:41107_ge_va%2Ft) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 976079 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 976092 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
   [junit4]   2> 976186 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 976196 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
   [junit4]   2> 976196 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 976196 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 976196 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
   [junit4]   2> 976199 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=47, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 976202 WARN  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 976244 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 976244 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 976245 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 976245 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 976246 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2643382224025981]
   [junit4]   2> 976247 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@1df0ca1[collection1_shard2_replica_t41] main]
   [junit4]   2> 976247 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 976247 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 976248 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 976248 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576780320398639104
   [junit4]   2> 976250 INFO  (searcherExecutor-2883-thread-1-processing-n:127.0.0.1:41107_ge_va%2Ft x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@1df0ca1[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 976253 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 976253 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 976253 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41107/ge_va/t/collection1_shard2_replica_t41/
   [junit4]   2> 976253 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 976253 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:41107/ge_va/t/collection1_shard2_replica_t41/ has no replicas
   [junit4]   2> 976253 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 976253 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
   [junit4]   2> 976254 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41107/ge_va/t/collection1_shard2_replica_t41/ shard2
   [junit4]   2> 976355 INFO  (zkCallback-1061-thread-1-processing-n:127.0.0.1:41107_ge_va%2Ft) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 976405 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 976406 INFO  (qtp10975815-6808) [n:127.0.0.1:41107_ge_va%2Ft c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1352
   [junit4]   2> 976407 INFO  (qtp10975815-6806) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:41107_ge_va%252Ft&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1366
   [junit4]   2> 976485 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-2-001 of type TLOG
   [junit4]   2> 976485 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 976487 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4c7bdc{/ge_va/t,null,AVAILABLE}
   [junit4]   2> 976487 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1372f43{HTTP/1.1,[http/1.1]}{127.0.0.1:34815}
   [junit4]   2> 976487 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.Server Started @977964ms
   [junit4]   2> 976487 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/ge_va/t, hostPort=40343, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-2-001/cores}
   [junit4]   2> 976487 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 976493 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 976493 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 976493 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 976493 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T08:08:14.424Z
   [junit4]   2> 976497 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 976497 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-2-001/solr.xml
   [junit4]   2> 976500 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 976503 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43349/solr
   [junit4]   2> 976507 INFO  (zkCallback-1061-thread-1-processing-n:127.0.0.1:41107_ge_va%2Ft) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 976511 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 976512 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 976513 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40343_ge_va%2Ft
   [junit4]   2> 976513 INFO  (zkCallback-1061-thread-1-processing-n:127.0.0.1:41107_ge_va%2Ft) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 976513 INFO  (zkCallback-1056-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 976513 INFO  (zkCallback-1049-thread-1-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 976517 INFO  (zkCallback-1067-thread-1-processing-n:127.0.0.1:40343_ge_va%2Ft) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 976630 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 976639 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 976639 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 976641 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-2-001/cores
   [junit4]   2> 976667 INFO  (qtp10975815-6807) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40343_ge_va%252Ft&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 976668 INFO  (OverseerCollectionConfigSetProcessor-98548769731182596-127.0.0.1:36149_ge_va%2Ft-n_0000000000) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 976669 INFO  (OverseerThreadFactory-2869-thread-4-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:40343_ge_va%2Ft for creating new replica
   [junit4]   2> 976669 INFO  (SocketProxy-Acceptor-40343) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=47544,localport=40343], receiveBufferSize:531000
   [junit4]   2> 976673 INFO  (SocketProxy-Acceptor-40343) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=34815,localport=38136], receiveBufferSize=530904
   [junit4]   2> 976673 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 976674 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 976777 INFO  (zkCallback-1061-thread-1-processing-n:127.0.0.1:41107_ge_va%2Ft) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 976777 INFO  (zkCallback-1067-thread-1-processing-n:127.0.0.1:40343_ge_va%2Ft) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 977685 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 977700 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
   [junit4]   2> 977805 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 977815 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
   [junit4]   2> 977816 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603
   [junit4]   2> 977816 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 977816 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
   [junit4]   2> 977819 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=47, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 977820 WARN  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 977877 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 977877 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 977878 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 977878 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 977880 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=10, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.2643382224025981]
   [junit4]   2> 977880 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@1e07965[collection1_shard1_replica_t43] main]
   [junit4]   2> 977882 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 977882 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 977883 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 977883 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576780322113060864
   [junit4]   2> 977885 INFO  (searcherExecutor-2894-thread-1-processing-n:127.0.0.1:40343_ge_va%2Ft x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@1e07965[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 977889 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 977889 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 977889 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:40343/ge_va/t/collection1_shard1_replica_t43/
   [junit4]   2> 977889 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 977889 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:40343/ge_va/t/collection1_shard1_replica_t43/ has no replicas
   [junit4]   2> 977889 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 977889 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
   [junit4]   2> 977890 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:40343/ge_va/t/collection1_shard1_replica_t43/ shard1
   [junit4]   2> 977991 INFO  (zkCallback-1067-thread-1-processing-n:127.0.0.1:40343_ge_va%2Ft) [n:127.0.0.1:40343_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 977991 INFO  (zkCallback-1061-thread-1-processing-n:127.0.0.1:41107_ge_va%2Ft) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 978041 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 978042 INFO  (qtp32828742-6840) [n:127.0.0.1:40343_ge_va%2Ft c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1368
   [junit4]   2> 978042 INFO  (qtp10975815-6807) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40343_ge_va%252Ft&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1375
   [junit4]   2> 978113 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-3-001 of type TLOG
   [junit4]   2> 978113 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 978115 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1d770b0{/ge_va/t,null,AVAILABLE}
   [junit4]   2> 978115 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4accaa{HTTP/1.1,[http/1.1]}{127.0.0.1:34541}
   [junit4]   2> 978115 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.e.j.s.Server Started @979593ms
   [junit4]   2> 978115 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/ge_va/t, hostPort=42327, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-3-001/cores}
   [junit4]   2> 978116 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 978116 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 978116 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 978116 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 978116 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T08:08:16.047Z
   [junit4]   2> 978121 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 978122 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_99F0ADBAE0C10765-001/shard-3-001/solr.xml
   [junit4]   2> 978125 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1240603, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 978127 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43349/solr
   [junit4]   2> 978131 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:42327_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 978132 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:42327_ge_va%2Ft    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 978132 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[99F0ADBAE0C10765]) [n:127.0.0.1:42327_ge_va%2Ft    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42327_ge_va%2Ft
   [junit4]   2> 978133 INFO  (zkCallback-1061-thread-1-processing-n:127.0.0.1:41107_ge_va%2Ft) [n:127.0.0.1:41107_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 978133 INFO  (zkCallback-1049-thread-2-processing-n:127.0.0.1:36149_ge_va%2Ft) [n:127.0.0.1:36149_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 978133 INFO  (zkCallback-1056-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 978133 INFO  (zkCallback-1073-thread-1-processing-n:127.0.0.1:42327_ge_va%2Ft) [n:127.0.0.1:42327_ge_va%2Ft    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKe

[...truncated too long message...]

1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174362 INFO  (zkCallback-745-thread-2-processing-n:127.0.0.1:44841_solr) [n:127.0.0.1:44841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174362 INFO  (zkCallback-752-thread-1-processing-n:127.0.0.1:45543_solr) [n:127.0.0.1:45543_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174363 INFO  (zkCallback-752-thread-2-processing-n:127.0.0.1:45543_solr) [n:127.0.0.1:45543_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/mainCorpus/state.json] for collection [mainCorpus] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174363 INFO  (zkCallback-752-thread-1-processing-n:127.0.0.1:45543_solr) [n:127.0.0.1:45543_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/mainCorpus/state.json] for collection [mainCorpus] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174363 INFO  (zkCallback-752-thread-1-processing-n:127.0.0.1:45543_solr) [n:127.0.0.1:45543_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/destination/state.json] for collection [destination] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174363 INFO  (zkCallback-752-thread-2-processing-n:127.0.0.1:45543_solr) [n:127.0.0.1:45543_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/destination/state.json] for collection [destination] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174364 INFO  (zkCallback-745-thread-2-processing-n:127.0.0.1:44841_solr) [n:127.0.0.1:44841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/destination/state.json] for collection [destination] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174364 INFO  (zkCallback-745-thread-1-processing-n:127.0.0.1:44841_solr) [n:127.0.0.1:44841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/destination/state.json] for collection [destination] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174366 INFO  (zkCallback-745-thread-1-processing-n:127.0.0.1:44841_solr) [n:127.0.0.1:44841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/workQueue/state.json] for collection [workQueue] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174366 INFO  (zkCallback-745-thread-2-processing-n:127.0.0.1:44841_solr) [n:127.0.0.1:44841_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/workQueue/state.json] for collection [workQueue] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 174367 INFO  (zkCallback-745-thread-3-processing-n:127.0.0.1:44841_solr) [n:127.0.0.1:44841_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 174373 INFO  (jetty-closer-735-thread-2) [    ] o.a.s.c.Overseer Overseer (id=98548863009423366-127.0.0.1:44841_solr-n_0000000000) closing
   [junit4]   2> 174373 INFO  (OverseerStateUpdate-98548863009423366-127.0.0.1:44841_solr-n_0000000000) [n:127.0.0.1:44841_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:44841_solr
   [junit4]   2> 175818 WARN  (zkCallback-751-thread-1-processing-n:127.0.0.1:44069_solr) [n:127.0.0.1:44069_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 175818 INFO  (jetty-closer-735-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@178acb5{/solr,null,UNAVAILABLE}
   [junit4]   2> 175865 WARN  (zkCallback-752-thread-1-processing-n:127.0.0.1:45543_solr) [n:127.0.0.1:45543_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 175865 INFO  (jetty-closer-735-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1d990f8{/solr,null,UNAVAILABLE}
   [junit4]   2> 175877 WARN  (zkCallback-745-thread-4-processing-n:127.0.0.1:44841_solr) [n:127.0.0.1:44841_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 175877 INFO  (jetty-closer-735-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4398c7{/solr,null,UNAVAILABLE}
   [junit4]   2> 175878 ERROR (SUITE-StreamExpressionTest-seed#[A64F71E6FD2F155A]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 175878 INFO  (SUITE-StreamExpressionTest-seed#[A64F71E6FD2F155A]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36255 36255
   [junit4]   2> 183931 INFO  (Thread-444) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:36255 36255
   [junit4]   2> 183931 WARN  (Thread-444) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	94	/solr/aliases.json
   [junit4]   2> 	8	/solr/configs/ml
   [junit4]   2> 	6	/solr/configs/conf
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	94	/solr/clusterprops.json
   [junit4]   2> 	94	/solr/clusterstate.json
   [junit4]   2> 	38	/solr/collections/destinationCollection/state.json
   [junit4]   2> 	30	/solr/collections/parallelDestinationCollection1/state.json
   [junit4]   2> 	22	/solr/collections/destination/state.json
   [junit4]   2> 	21	/solr/collections/mainCorpus/state.json
   [junit4]   2> 	20	/solr/collections/parallelDestinationCollection/state.json
   [junit4]   2> 	19	/solr/collections/workQueue/state.json
   [junit4]   2> 	12	/solr/collections/collection1/state.json
   [junit4]   2> 	10	/solr/collections/uknownCollection/state.json
   [junit4]   2> 	10	/solr/collections/modelCollection/state.json
   [junit4]   2> 	10	/solr/collections/checkpointCollection/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	94	/solr/live_nodes
   [junit4]   2> 	94	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J2/temp/solr.client.solrj.io.stream.StreamExpressionTest_A64F71E6FD2F155A-001
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=fr-FR, timezone=SystemV/HST10
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=146787216,total=321388544
   [junit4]   2> NOTE: All tests run in this JVM: [AndEvaluatorTest, CubedRootEvaluatorTest, ModifiableSolrParamsTest, JettyWebappTest, JdbcTest, GreaterThanEvaluatorTest, GraphExpressionTest, NaturalLogEvaluatorTest, TestConfigSetAdminRequest, CloudSolrClientCacheTest, SchemaTest, TestZkConfigManager, TestJavaBinCodec, SolrParamTest, TestBatchUpdate, EmpiricalDistributionEvaluatorTest, HttpSolrClientConPoolTest, TestPathTrie, ConcurrentUpdateSolrClientBuilderTest, ReverseEvaluatorTest, SolrExceptionTest, StreamExpressionTest]
   [junit4] Completed [143/145 (1!)] on J2 in 109.84s, 95 tests, 1 error <<< FAILURES!

[...truncated 1805 lines...]
   [junit4] Suite: org.apache.solr.analytics.NoFacetCloudTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/J0/temp/solr.analytics.NoFacetCloudTest_4E874E67E30C1AEC-001/init-core-data-001
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=true): {}, locale=es-PY, timezone=AET
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=176475328,total=225968128
   [junit4]   2> NOTE: All tests run in this JVM: [AbstractAnalyticsStatsCloudTest, FieldFacetTest, NoFacetTest, NoFacetCloudTest]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=NoFacetCloudTest -Dtests.seed=4E874E67E30C1AEC -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es-PY -Dtests.timezone=AET -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] ERROR   0.00s J0 | NoFacetCloudTest (suite) <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Could not find collection:collection1
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([4E874E67E30C1AEC]:0)
   [junit4]    > 	at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
   [junit4]    > 	at org.apache.solr.analytics.AbstractAnalyticsStatsCloudTest.setupCluster(AbstractAnalyticsStatsCloudTest.java:76)
   [junit4]    > 	at org.apache.solr.analytics.NoFacetCloudTest.populate(NoFacetCloudTest.java:62)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4] Completed [17/17 (1!)] on J0 in 43.58s, 0 tests, 1 failure <<< FAILURES!

[...truncated 36720 lines...]

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+181) - Build # 20374 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20374/
Java: 64bit/jdk-9-ea+181 -XX:-UseCompressedOops -XX:+UseG1GC --illegal-access=deny

4 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Doc with id=1 not found in http://127.0.0.1:45627/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:45627/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([810DFFD5980FF6F1:959C00F36F39B09]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete

Error Message:
Error from server at https://127.0.0.1:37353/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason: <pre>    Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:37353/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([810DFFD5980FF6F1:22F751701FE71C54]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
	at org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete(TestCollectionsAPIViaSolrCloudCluster.java:167)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:37353/solr/testcollection_shard1_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n3/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	... 1 more


FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
count1=6, count2=6 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: count1=6, count2=6 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([810DFFD5980FF6F1:DEE9D2E2F30365B4]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:90)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping

Error Message:
Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.

Stack Trace:
java.lang.AssertionError: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
	at __randomizedtesting.SeedInfo.seed([810DFFD5980FF6F1:F0E90103EEE4D13D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 10793 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/init-core-data-001
   [junit4]   2> 0    INFO  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[810DFFD5980FF6F1]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 49   INFO  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[810DFFD5980FF6F1]-worker) [    ] o.e.j.u.log Logging initialized @1631ms
   [junit4]   2> 56   INFO  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[810DFFD5980FF6F1]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 268  INFO  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[810DFFD5980FF6F1]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 305  INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-001
   [junit4]   2> 315  INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 330  INFO  (Thread-0) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 330  INFO  (Thread-0) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 429  INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.ZkTestServer start zk server on port:37619
   [junit4]   2> 576  WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Exception causing close of session 0x0 due to java.io.IOException: ZooKeeperServer not running
   [junit4]   2> 649  ERROR (Thread-0) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2641 INFO  (jetty-launcher-1-thread-4) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2641 INFO  (jetty-launcher-1-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2644 INFO  (jetty-launcher-1-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2644 INFO  (jetty-launcher-1-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2644 INFO  (jetty-launcher-1-thread-5) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2689 INFO  (jetty-launcher-1-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@d83b556{/solr,null,AVAILABLE}
   [junit4]   2> 2707 INFO  (jetty-launcher-1-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7e9cd040{/solr,null,AVAILABLE}
   [junit4]   2> 2716 INFO  (jetty-launcher-1-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4ed6d8d9{/solr,null,AVAILABLE}
   [junit4]   2> 2717 INFO  (jetty-launcher-1-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@225f1dc8{/solr,null,AVAILABLE}
   [junit4]   2> 2719 INFO  (jetty-launcher-1-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4638bc76{SSL,[ssl, http/1.1]}{127.0.0.1:37645}
   [junit4]   2> 2719 INFO  (jetty-launcher-1-thread-1) [    ] o.e.j.s.Server Started @4305ms
   [junit4]   2> 2719 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37645}
   [junit4]   2> 2720 INFO  (jetty-launcher-1-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4722089d{SSL,[ssl, http/1.1]}{127.0.0.1:37847}
   [junit4]   2> 2721 INFO  (jetty-launcher-1-thread-3) [    ] o.e.j.s.Server Started @4307ms
   [junit4]   2> 2721 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37847}
   [junit4]   2> 2724 INFO  (jetty-launcher-1-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@648b2cb8{/solr,null,AVAILABLE}
   [junit4]   2> 2725 INFO  (jetty-launcher-1-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@130b8b55{SSL,[ssl, http/1.1]}{127.0.0.1:41871}
   [junit4]   2> 2725 INFO  (jetty-launcher-1-thread-2) [    ] o.e.j.s.Server Started @4311ms
   [junit4]   2> 2725 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41871}
   [junit4]   2> 2725 INFO  (jetty-launcher-1-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6e83a495{SSL,[ssl, http/1.1]}{127.0.0.1:35027}
   [junit4]   2> 2726 INFO  (jetty-launcher-1-thread-4) [    ] o.e.j.s.Server Started @4312ms
   [junit4]   2> 2726 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35027}
   [junit4]   2> 2726 INFO  (jetty-launcher-1-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2782b8dc{SSL,[ssl, http/1.1]}{127.0.0.1:35035}
   [junit4]   2> 2726 INFO  (jetty-launcher-1-thread-5) [    ] o.e.j.s.Server Started @4312ms
   [junit4]   2> 2726 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35035}
   [junit4]   2> 2763 ERROR (jetty-launcher-1-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2763 ERROR (jetty-launcher-1-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2763 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 2763 ERROR (jetty-launcher-1-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2763 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 2763 ERROR (jetty-launcher-1-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2766 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 2763 ERROR (jetty-launcher-1-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2765 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 2769 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2769 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2772 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2769 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2767 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 2775 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2775 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2772 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2772 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2776 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2776 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2785 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T02:50:39.912305Z
   [junit4]   2> 2788 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T02:50:39.912402Z
   [junit4]   2> 2788 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T02:50:39.912004Z
   [junit4]   2> 2788 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T02:50:39.912100Z
   [junit4]   2> 2788 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T02:50:39.910564Z
   [junit4]   2> 2856 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 2856 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 2856 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.c.SolrResourceLoader solr home defaulted to 'solr/' (could not find system property or JNDI)
   [junit4]   2> 2949 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2955 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2960 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2971 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2995 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 3133 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e1c72c65d0004, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 3319 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37619/solr
   [junit4]   2> 3320 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37619/solr
   [junit4]   2> 3416 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37619/solr
   [junit4]   2> 3381 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37619/solr
   [junit4]   2> 3361 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37619/solr
   [junit4]   2> 3476 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e1c72c65d0006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 3551 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e1c72c65d000a, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 4057 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4058 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4059 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4060 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41871_solr
   [junit4]   2> 4065 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37847_solr
   [junit4]   2> 4066 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4067 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.c.Overseer Overseer (id=98547521128562703-127.0.0.1:41871_solr-n_0000000000) starting
   [junit4]   2> 4068 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35035_solr
   [junit4]   2> 4073 INFO  (zkCallback-25-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 4074 INFO  (zkCallback-28-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 4074 INFO  (zkCallback-24-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 4074 INFO  (zkCallback-27-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 4076 INFO  (zkCallback-26-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 4078 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 4081 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37645_solr
   [junit4]   2> 4085 INFO  (zkCallback-27-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 4085 INFO  (zkCallback-26-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 4086 INFO  (zkCallback-28-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 4086 INFO  (zkCallback-25-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 4086 INFO  (zkCallback-24-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 4087 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35027_solr
   [junit4]   2> 4087 INFO  (zkCallback-26-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 4087 INFO  (zkCallback-27-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 4087 INFO  (zkCallback-24-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 4087 INFO  (zkCallback-28-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 4092 INFO  (zkCallback-25-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 4104 INFO  (zkCallback-24-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 4105 INFO  (zkCallback-28-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 4113 INFO  (zkCallback-25-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 4113 INFO  (zkCallback-26-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 4114 INFO  (zkCallback-27-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 4185 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41871_solr
   [junit4]   2> 4189 INFO  (zkCallback-27-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 4189 INFO  (zkCallback-25-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 4189 INFO  (zkCallback-26-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 4189 INFO  (zkCallback-24-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 4190 INFO  (zkCallback-28-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 4955 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35027.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4957 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35027.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4957 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35027.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4978 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37645.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4979 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37645.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4979 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37645.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4980 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35035.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4980 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35035.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4981 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35035.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4984 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41871.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4984 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41871.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4984 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41871.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4986 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37847.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4986 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37847.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 4987 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37847.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 5014 INFO  (jetty-launcher-1-thread-3) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-001/node3/.
   [junit4]   2> 5019 INFO  (jetty-launcher-1-thread-4) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-001/node4/.
   [junit4]   2> 5021 INFO  (jetty-launcher-1-thread-2) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-001/node2/.
   [junit4]   2> 5021 INFO  (jetty-launcher-1-thread-1) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-001/node1/.
   [junit4]   2> 5021 INFO  (jetty-launcher-1-thread-5) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-001/node5/.
   [junit4]   2> 5597 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 5599 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37619/solr ready
   [junit4]   2> 5605 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCollectionCreateWithoutCoresThenDelete
   [junit4]   2> 5931 INFO  (qtp914839543-66) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=1&name=testSolrCloudCollectionWithoutCores&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=EMPTY&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 5940 INFO  (OverseerThreadFactory-22-thread-1) [    ] o.a.s.c.CreateCollectionCmd Create collection testSolrCloudCollectionWithoutCores
   [junit4]   2> 5945 WARN  (OverseerThreadFactory-22-thread-1) [    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (testSolrCloudCollectionWithoutCores) without cores.
   [junit4]   2> 6068 INFO  (qtp914839543-66) [    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 6068 INFO  (qtp914839543-66) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=1&name=testSolrCloudCollectionWithoutCores&nrtReplicas=2&action=CREATE&numShards=2&createNodeSet=EMPTY&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2} status=0 QTime=153
   [junit4]   2> 6085 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: testSolrCloudCollectionWithoutCores failOnTimeout:true timeout (sec):330
   [junit4]   1> -
   [junit4]   1> no one is recoverying
   [junit4]   2> 6086 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: testSolrCloudCollectionWithoutCores
   [junit4]   2> 6089 INFO  (qtp914839543-67) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :delete with params name=testSolrCloudCollectionWithoutCores&action=DELETE&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 6093 INFO  (OverseerCollectionConfigSetProcessor-98547521128562703-127.0.0.1:41871_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 6095 INFO  (OverseerThreadFactory-22-thread-2) [    ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=UNLOAD&deleteInstanceDir=true&deleteDataDir=true
   [junit4]   2> 6800 INFO  (qtp914839543-67) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={name=testSolrCloudCollectionWithoutCores&action=DELETE&wt=javabin&version=2} status=0 QTime=711
   [junit4]   2> 6801 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for collection to disappear - collection: testSolrCloudCollectionWithoutCores failOnTimeout:true timeout (sec):330
   [junit4]   1> -
   [junit4]   2> 6801 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.AbstractDistribZkTestBase Collection has disappeared - collection: testSolrCloudCollectionWithoutCores
   [junit4]   2> 6807 INFO  (jetty-closer-2-thread-4) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@130b8b55{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 6807 INFO  (jetty-closer-2-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@4638bc76{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 6807 INFO  (jetty-closer-2-thread-4) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=584413844
   [junit4]   2> 6807 INFO  (jetty-closer-2-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1797612547
   [junit4]   2> 6808 INFO  (jetty-closer-2-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 6808 INFO  (jetty-closer-2-thread-5) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@4722089d{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 6808 INFO  (jetty-closer-2-thread-3) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@6e83a495{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 6812 INFO  (jetty-closer-2-thread-3) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1385427114
   [junit4]   2> 6808 INFO  (jetty-closer-2-thread-5) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1945867179
   [junit4]   2> 6815 INFO  (jetty-closer-2-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 6816 INFO  (jetty-closer-2-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@2782b8dc{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 6812 INFO  (jetty-closer-2-thread-4) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 6816 INFO  (jetty-closer-2-thread-5) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 6816 INFO  (jetty-closer-2-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=260165176
   [junit4]   2> 6816 INFO  (jetty-closer-2-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7993243a: rootName = solr_37645, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@77e72fa0
   [junit4]   2> 6816 INFO  (jetty-closer-2-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 6816 INFO  (jetty-closer-2-thread-4) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1aeebcdc: rootName = solr_41871, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1d4b3ea9
   [junit4]   2> 6817 INFO  (jetty-closer-2-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4f21c7e3: rootName = solr_35035, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@38c79414
   [junit4]   2> 6816 INFO  (jetty-closer-2-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@92d2d7a: rootName = solr_35027, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@3f918a5c
   [junit4]   2> 6816 INFO  (jetty-closer-2-thread-5) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@42af92d4: rootName = solr_37847, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@5b179626
   [junit4]   2> 6842 INFO  (jetty-closer-2-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 6842 INFO  (jetty-closer-2-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7c1570ec: rootName = solr_37645, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@73d8a584
   [junit4]   2> 6843 INFO  (jetty-closer-2-thread-4) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 6843 INFO  (jetty-closer-2-thread-4) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@49935ea6: rootName = solr_41871, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@73d8a584
   [junit4]   2> 6843 INFO  (jetty-closer-2-thread-5) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 6843 INFO  (jetty-closer-2-thread-5) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@19b42578: rootName = solr_37847, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@73d8a584
   [junit4]   2> 6844 INFO  (jetty-closer-2-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 6844 INFO  (jetty-closer-2-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4fa156ff: rootName = solr_35027, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@73d8a584
   [junit4]   2> 6844 INFO  (jetty-closer-2-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 6844 INFO  (jetty-closer-2-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4b35306: rootName = solr_35035, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@73d8a584
   [junit4]   2> 6856 INFO  (jetty-closer-2-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 6856 INFO  (jetty-closer-2-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3f03e69c: rootName = solr_37645, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@36da259b
   [junit4]   2> 6857 INFO  (jetty-closer-2-thread-4) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 6857 INFO  (jetty-closer-2-thread-4) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@62d19abe: rootName = solr_41871, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@36da259b
   [junit4]   2> 6858 INFO  (jetty-closer-2-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 6860 INFO  (jetty-closer-2-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 6861 INFO  (jetty-closer-2-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 6861 INFO  (jetty-closer-2-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@28b5a542: rootName = solr_35035, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@36da259b
   [junit4]   2> 6861 INFO  (jetty-closer-2-thread-4) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 6861 INFO  (jetty-closer-2-thread-4) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 6861 INFO  (jetty-closer-2-thread-5) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 6861 INFO  (jetty-closer-2-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 6862 INFO  (jetty-closer-2-thread-4) [    ] o.a.s.c.Overseer Overseer (id=98547521128562703-127.0.0.1:41871_solr-n_0000000000) closing
   [junit4]   2> 6862 INFO  (jetty-closer-2-thread-3) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@28bc64ef: rootName = solr_35027, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@36da259b
   [junit4]   2> 6862 INFO  (jetty-closer-2-thread-5) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@301cc4b7: rootName = solr_37847, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@36da259b
   [junit4]   2> 6862 INFO  (OverseerStateUpdate-98547521128562703-127.0.0.1:41871_solr-n_0000000000) [    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:41871_solr
   [junit4]   2> 6865 INFO  (zkCallback-26-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
   [junit4]   2> 6865 INFO  (zkCallback-28-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
   [junit4]   2> 6865 INFO  (zkCallback-25-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
   [junit4]   2> 6865 INFO  (zkCallback-24-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (3)
   [junit4]   2> 6866 WARN  (zkCallback-28-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 6867 INFO  (jetty-closer-2-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 6868 INFO  (zkCallback-25-thread-1) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37847_solr
   [junit4]   2> 6868 INFO  (jetty-closer-2-thread-2) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 6868 INFO  (zkCallback-25-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
   [junit4]   2> 6868 INFO  (jetty-closer-2-thread-3) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 6869 INFO  (jetty-closer-2-thread-5) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 6869 INFO  (jetty-closer-2-thread-3) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 6869 INFO  (jetty-closer-2-thread-5) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 6872 INFO  (jetty-closer-2-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@225f1dc8{/solr,null,UNAVAILABLE}
   [junit4]   2> 6874 INFO  (jetty-closer-2-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@d83b556{/solr,null,UNAVAILABLE}
   [junit4]   2> 8369 WARN  (zkCallback-26-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 8370 INFO  (jetty-closer-2-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@648b2cb8{/solr,null,UNAVAILABLE}
   [junit4]   2> 8374 WARN  (zkCallback-25-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 8374 WARN  (zkCallback-24-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 8374 INFO  (jetty-closer-2-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@7e9cd040{/solr,null,UNAVAILABLE}
   [junit4]   2> 8374 INFO  (jetty-closer-2-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4ed6d8d9{/solr,null,UNAVAILABLE}
   [junit4]   2> 8375 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 8375 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37619 37619
   [junit4]   2> 23389 INFO  (Thread-0) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37619 37619
   [junit4]   2> 23390 WARN  (Thread-0) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 
   [junit4]   2> 23392 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[810DFFD5980FF6F1]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testCollectionCreateWithoutCoresThenDelete
   [junit4]   2> 23434 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-002
   [junit4]   2> 23434 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 23436 INFO  (Thread-47) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 23436 INFO  (Thread-47) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 23448 ERROR (Thread-47) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 23536 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.ZkTestServer start zk server on port:36881
   [junit4]   2> 23581 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e1c73205e0000, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 23588 INFO  (jetty-launcher-38-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 23595 INFO  (jetty-launcher-38-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 23603 INFO  (jetty-launcher-38-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 23606 INFO  (jetty-launcher-38-thread-4) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 23610 INFO  (jetty-launcher-38-thread-5) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 23638 INFO  (jetty-launcher-38-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@75bb35e0{/solr,null,AVAILABLE}
   [junit4]   2> 23660 INFO  (jetty-launcher-38-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7c3de9dd{/solr,null,AVAILABLE}
   [junit4]   2> 23661 INFO  (jetty-launcher-38-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2d9527ab{SSL,[ssl, http/1.1]}{127.0.0.1:40491}
   [junit4]   2> 23661 INFO  (jetty-launcher-38-thread-2) [    ] o.e.j.s.Server Started @25247ms
   [junit4]   2> 23661 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=40491}
   [junit4]   2> 23662 ERROR (jetty-launcher-38-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 23662 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 23662 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 23662 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 23662 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T02:51:00.798650Z
   [junit4]   2> 23666 INFO  (jetty-launcher-38-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@564dfef8{SSL,[ssl, http/1.1]}{127.0.0.1:36453}
   [junit4]   2> 23666 INFO  (jetty-launcher-38-thread-1) [    ] o.e.j.s.Server Started @25253ms
   [junit4]   2> 23667 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36453}
   [junit4]   2> 23667 ERROR (jetty-launcher-38-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 23667 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 23667 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 23667 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 23667 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T02:51:00.803722Z
   [junit4]   2> 23698 INFO  (jetty-launcher-38-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5729439d{/solr,null,AVAILABLE}
   [junit4]   2> 23772 INFO  (jetty-launcher-38-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@786a7af9{/solr,null,AVAILABLE}
   [junit4]   2> 23799 INFO  (jetty-launcher-38-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@62b117cc{/solr,null,AVAILABLE}
   [junit4]   2> 23807 INFO  (jetty-launcher-38-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@20115192{SSL,[ssl, http/1.1]}{127.0.0.1:43843}
   [junit4]   2> 23807 INFO  (jetty-launcher-38-thread-5) [    ] o.e.j.s.Server Started @25393ms
   [junit4]   2> 23807 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43843}
   [junit4]   2> 23808 ERROR (jetty-launcher-38-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 23808 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 23808 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 23808 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 23808 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T02:51:00.944469Z
   [junit4]   2> 23809 INFO  (jetty-launcher-38-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@5c8886bd{SSL,[ssl, http/1.1]}{127.0.0.1:36223}
   [junit4]   2> 23809 INFO  (jetty-launcher-38-thread-3) [    ] o.e.j.s.Server Started @25395ms
   [junit4]   2> 23809 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36223}
   [junit4]   2> 23809 ERROR (jetty-launcher-38-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 23810 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 23810 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 23810 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 23810 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T02:51:00.946307Z
   [junit4]   2> 23821 INFO  (jetty-launcher-38-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@24d5ac08{SSL,[ssl, http/1.1]}{127.0.0.1:44337}
   [junit4]   2> 23821 INFO  (jetty-launcher-38-thread-4) [    ] o.e.j.s.Server Started @25408ms
   [junit4]   2> 23821 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=44337}
   [junit4]   2> 23822 ERROR (jetty-launcher-38-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 23822 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 23822 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 23822 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 23822 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-26T02:51:00.958509Z
   [junit4]   2> 23831 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 23850 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 23924 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 23924 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 23925 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36881/solr
   [junit4]   2> 23937 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 23939 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36881/solr
   [junit4]   2> 23988 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36881/solr
   [junit4]   2> 24026 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36881/solr
   [junit4]   2> 24036 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36881/solr
   [junit4]   2> 24073 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e1c73205e0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 24129 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 24130 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36453_solr
   [junit4]   2> 24141 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98547522638577674-127.0.0.1:36453_solr-n_0000000000) starting
   [junit4]   2> 24161 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e1c73205e000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 24208 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e1c73205e000c, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 24221 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 24224 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36223_solr
   [junit4]   2> 24272 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 24274 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 24276 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40491_solr
   [junit4]   2> 24312 INFO  (zkCallback-63-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 24312 INFO  (zkCallback-57-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 24335 INFO  (zkCallback-55-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 24341 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36453_solr
   [junit4]   2> 24349 INFO  (zkCallback-55-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 24349 INFO  (zkCallback-63-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 24349 INFO  (zkCallback-57-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 24361 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 24361 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 24363 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 24363 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 24366 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43843_solr
   [junit4]   2> 24367 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44337_solr
   [junit4]   2> 24368 INFO  (zkCallback-63-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 24368 INFO  (zkCallback-57-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 24368 INFO  (zkCallback-55-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 24375 INFO  (zkCallback-67-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 24400 INFO  (zkCallback-63-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 24401 INFO  (zkCallback-55-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 24401 INFO  (zkCallback-57-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 24412 INFO  (zkCallback-67-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 24436 INFO  (zkCallback-66-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (5)
   [junit4]   2> 24489 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36223.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24581 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36453.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24584 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36223.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24585 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36223.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24589 INFO  (jetty-launcher-38-thread-3) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-002/node3/.
   [junit4]   2> 24654 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40491.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24672 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36453.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24673 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36453.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24680 INFO  (jetty-launcher-38-thread-1) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-002/node1/.
   [junit4]   2> 24683 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44337.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24691 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43843.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24720 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40491.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24720 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_40491.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24722 INFO  (jetty-launcher-38-thread-2) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-002/node2/.
   [junit4]   2> 24763 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44337.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24765 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_44337.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24771 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43843.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24772 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43843.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@7723980b
   [junit4]   2> 24776 INFO  (jetty-launcher-38-thread-5) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-002/node5/.
   [junit4]   2> 24777 INFO  (jetty-launcher-38-thread-4) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_810DFFD5980FF6F1-001/tempDir-002/node4/.
   [junit4]   2> 25270 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 25271 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[810DFFD5980FF6F1]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36881/solr ready
   [junit4]   2> 25274 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[810DFFD5980FF6F1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testStopAllStartAll
   [junit4]   2> 25319 INFO  (qtp579404502-182) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=70ba7d9e-f58b-4da7-8513-a28c4beb2f48&replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=1&name=testStopAllStartAllCollection&nrtReplicas=2&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 25321 INFO  (qtp579404502-182) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=70ba7d9e-f58b-4da7-8513-a28c4beb2f48&replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=1&name=testStopAllStartAllCollection&nrtReplicas=2&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 25324 INFO  (OverseerThreadFactory-59-thread-1) [    ] o.a.s.c.CreateCollectionCmd Create collection testStopAllStartAllCollection
   [junit4]   2> 25342 INFO  (qtp579404502-175) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=70ba7d9e-f58b-4da7-8513-a28c4beb2f48&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 25343 INFO  (qtp579404502-175) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=70ba7d9e-f58b-4da7-8513-a28c4beb2f48&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 25480 INFO  (OverseerStateUpdate-98547522638577674-127.0.0.1:36453_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testStopAllStartAllCollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testStopAllStartAllCollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36453/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 25493 INFO  (OverseerStateUpdate-98547522638577674-127.0.0.1:36453_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testStopAllStartAllCollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testStopAllStartAllCollection_shard1_replica_n3",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:44337/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 25502 INFO  (OverseerStateUpdate-98547522638577674-127.0.0.1:36453_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testStopAllStartAllCollection",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testStopAllStartAllCollection_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:43843/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 25511 INFO  (OverseerStateUpdate-98547522638577674-127.0.0.1:36453_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testStopAllStartAllCollection",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testStopAllStartAllCollection_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:40491/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 25676 INFO  (qtp210423667-184) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testStopAllStartAllCollection&version=2&replicaType=NRT&async=70ba7d9e-f58b-4da7-8513-a28c4beb2f482712785632521179&coreNodeName=core_node5&name=testStopAllStartAllCollection_shard1_replica_n3&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=5
   [junit4]   2> 25681 INFO  (parallelCoreAdminExecutor-62-thread-1) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testStopAllStartAllCollection&version=2&replicaType=NRT&async=70ba7d9e-f58b-4da7-8513-a28c4beb2f482712785632521179&coreNodeName=core_node5&name=testStopAllStartAllCollection_shard1_replica_n3&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 25681 INFO  (qtp579404502-182) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testStopAllStartAllCollection&version=2&replicaType=NRT&async=70ba7d9e-f58b-4da7-8513-a28c4beb2f482712785618678737&coreNodeName=core_node2&name=testStopAllStartAllCollection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=0
   [junit4]   2> 25686 INFO  (parallelCoreAdminExecutor-62-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 25682 INFO  (parallelCoreAdminExecutor-64-thread-1) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testStopAllStartAllCollection&version=2&replicaType=NRT&async=70ba7d9e-f58b-4da7-8513-a28c4beb2f482712785618678737&coreNodeName=core_node2&name=testStopAllStartAllCollection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 25687 INFO  (parallelCoreAdminExecutor-64-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 25689 INFO  (qtp2063764993-207) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testStopAllStartAllCollection&version=2&replicaType=NRT&async=70ba7d9e-f58b-4da7-8513-a28c4beb2f482712785650648308&coreNodeName=core_node8&name=testStopAllStartAllCollection_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=1
   [junit4]   2> 25689 INFO  (parallelCoreAdminExecutor-63-thread-1) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testStopAllStartAllCollection&version=2&replicaType=NRT&async=70ba7d9e-f58b-4da7-8513-a28c4beb2f482712785650648308&coreNodeName=core_node8&name=testStopAllStartAllCollection_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&

[...truncated too long message...]

estIndexingPerformance, RequiredFieldsTest, FastVectorHighlighterTest, IndexSchemaTest, MBeansHandlerTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestMergePolicyConfig, SampleTest, TestDocSet, TestElisionMultitermQuery, TestConfig, OutputWriterTest, ExternalFileFieldSortTest, TestSolrCoreProperties, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, EchoParamsTest, TestSweetSpotSimilarityFactory, TestIBSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, TimeZoneUtilsTest, TestFastOutputStream, OpenExchangeRatesOrgProviderTest, URLClassifyProcessorTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, ClusterStateTest, TestSolrJ, TestDocumentBuilder, ZkNodePropsTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, TestCursorMarkWithoutUniqueKey, TestSimpleTrackingShardHandler, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, ConnectionReuseTest, BaseCdcrDistributedZkTest, CdcrBootstrapTest, CollectionsAPISolrJTest, DeleteShardTest, DeleteStatusTest, DistributedQueueTest, HealthCheckHandlerTest, HttpPartitionTest]
   [junit4] Completed [513/732 (3!)] on J2 in 32.10s, 1 test, 1 failure <<< FAILURES!

[...truncated 391 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_810DFFD5980FF6F1-001/init-core-data-001
   [junit4]   2> 2622491 WARN  (SUITE-SolrSlf4jReporterTest-seed#[810DFFD5980FF6F1]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 2622491 INFO  (SUITE-SolrSlf4jReporterTest-seed#[810DFFD5980FF6F1]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 2622491 INFO  (SUITE-SolrSlf4jReporterTest-seed#[810DFFD5980FF6F1]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 2622492 INFO  (SUITE-SolrSlf4jReporterTest-seed#[810DFFD5980FF6F1]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2622492 INFO  (TEST-SolrSlf4jReporterTest.testReporter-seed#[810DFFD5980FF6F1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testReporter
   [junit4]   2> 2628864 INFO  (TEST-SolrSlf4jReporterTest.testReporter-seed#[810DFFD5980FF6F1]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testReporter
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=810DFFD5980FF6F1 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ewo-CM -Dtests.timezone=Etc/GMT+0 -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 6.37s J1 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: count1=6, count2=6 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([810DFFD5980FF6F1:DEE9D2E2F30365B4]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:90)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 2628865 INFO  (SUITE-SolrSlf4jReporterTest-seed#[810DFFD5980FF6F1]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_810DFFD5980FF6F1-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=171, maxMBSortInHeap=7.788467879897898, sim=RandomSimilarity(queryNorm=false): {}, locale=ewo-CM, timezone=Etc/GMT+0
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 9 (64-bit)/cpus=8,threads=1,free=339995512,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [TestCollectionsAPIViaSolrCloudCluster, CoreAdminHandlerTest, TestCoreContainer, TestScoreJoinQPNoScore, TestRestManager, TestExactSharedStatsCache, SaslZkACLProviderTest, TestTlogReplica, TlogReplayBufferedWhileIndexingTest, SolrMetricReporterTest, BadComponentTest, DistributedTermsComponentTest, TestMaxScoreQueryParser, ImplicitSnitchTest, DataDrivenBlockJoinTest, TestXIncludeConfig, CdcrReplicationHandlerTest, CoreMergeIndexesAdminHandlerTest, DocValuesMultiTest, ChaosMonkeySafeLeaderTest, TestSolrConfigHandlerConcurrent, TestSolrFieldCacheBean, ClassificationUpdateProcessorTest, ResponseHeaderTest, TestMultiValuedNumericRangeQuery, TestBlobHandler, TestSegmentSorting, TestCoreDiscovery, TestSha256AuthenticationProvider, TestSolrCLIRunExample, TestNoOpRegenerator, TestBackupRepositoryFactory, CleanupOldIndexTest, ScriptEngineTest, SpatialFilterTest, NoCacheHeaderTest, TestStressCloudBlindAtomicUpdates, TestHdfsCloudBackupRestore, TestStressRecovery, TestSmileRequest, TestExpandComponent, SubstringBytesRefFilterTest, TestFuzzyAnalyzedSuggestions, BasicAuthIntegrationTest, CSVRequestHandlerTest, HdfsBasicDistributedZk2Test, TestSearchPerf, TestDFISimilarityFactory, DistributedFacetPivotWhiteBoxTest, MissingSegmentRecoveryTest, TestSchemaVersionResource, GraphQueryTest, TestCustomDocTransformer, TestCloudDeleteByQuery, ZkControllerTest, HdfsChaosMonkeySafeLeaderTest, SoftAutoCommitTest, JsonLoaderTest, TestAtomicUpdateErrorCases, TestFiltering, BasicFunctionalityTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, FileBasedSpellCheckerTest, TestSystemIdResolver, AnalyticsMergeStrategyTest, AssignBackwardCompatibilityTest, TestLeaderInitiatedRecoveryThread, MetricUtilsTest, TestTrackingShardHandlerFactory, TestReplicationHandlerBackup, TestManagedStopFilterFactory, PrimUtilsTest, SharedFSAutoReplicaFailoverUtilsTest, TestConfigSetProperties, AtomicUpdatesTest, SuggesterTSTTest, BitVectorTest, StatsReloadRaceTest, DeleteInactiveReplicaTest, CloudMLTQParserTest, IndexSchemaRuntimeFieldTest, DirectSolrConnectionTest, BadCopyFieldTest, PropertiesRequestHandlerTest, TestStreamBody, TestPostingsSolrHighlighter, TestPerFieldSimilarity, SchemaVersionSpecificBehaviorTest, DistributedSuggestComponentTest, HdfsSyncSliceTest, TestPayloadScoreQParserPlugin, LargeFieldTest, TestNumericTerms32, ClusterStateUpdateTest, TestMaxTokenLenTokenizer, SliceStateTest, TestLRUCache, OverseerModifyCollectionTest, ConfigureRecoveryStrategyTest, SolrGraphiteReporterTest, AnalysisAfterCoreReloadTest, HdfsUnloadDistributedZkTest, ResourceLoaderTest, LoggingHandlerTest, DistributedExpandComponentTest, RestartWhileUpdatingTest, TestCustomStream, TestPartialUpdateDeduplication, HdfsLockFactoryTest, EnumFieldTest, ConnectionManagerTest, TestCloudPivotFacet, TolerantUpdateProcessorTest, ConvertedLegacyTest, TestDistribDocBasedVersion, DistanceFunctionTest, WrapperMergePolicyFactoryTest, CollectionsAPIDistributedZkTest, DisMaxRequestHandlerTest, TestCloudManagedSchema, OutOfBoxZkACLAndCredentialsProvidersTest, SyncSliceTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, BasicZkTest, FullSolrCloudDistribCmdsTest, TestZkChroot, TestRandomDVFaceting, ZkCLITest, ShardRoutingCustomTest, TestDistributedGrouping, TestFaceting, TestRecovery, TestHashPartitioner, HardAutoCommitTest, SimpleFacetsTest, SolrCoreTest, SpellCheckComponentTest, TestGroupingSearch, QueryElevationComponentTest, PeerSyncTest, SuggesterWFSTTest, TestCSVLoader, PolyFieldTest, WordBreakSolrSpellCheckerTest, TestUpdate, QueryEqualityTest, StatelessScriptUpdateProcessorFactoryTest, TestSurroundQueryParser, DirectSolrSpellCheckerTest, TestQueryTypes, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, SolrPluginUtilsTest, TestCollationField, UpdateRequestProcessorFactoryTest, QueryParsingTest, TestAnalyzedSuggestions, UniqFieldsUpdateProcessorFactoryTest, BinaryUpdateRequestHandlerTest, SearchHandlerTest, TestLFUCache, TestRTGBase, DistributedIntervalFacetingTest, AliasIntegrationTest, AsyncCallRequestStatusResponseTest, CdcrVersionReplicationTest, CloudExitableDirectoryReaderTest, CollectionStateFormat2Test, CollectionsAPIAsyncDistributedZkTest, CreateCollectionCleanupTest, DeleteLastCustomShardedReplicaTest, DeleteNodeTest, DeleteReplicaTest, DistribCursorPagingTest, ForceLeaderTest, MoveReplicaHDFSTest, MultiThreadedOCPTest, PeerSyncReplicationTest, SSLMigrationTest, ShardSplitTest, HdfsRecoverLeaseTest, HdfsRecoveryZkTest, TestClusterStateMutator, ZkStateWriterTest, BlobRepositoryCloudTest, CachingDirectoryFactoryTest, TestImplicitCoreProperties, TestInfoStreamLogging, TestNRTOpen, TestSolrXml, TestSolrCloudSnapshots, DistributedFacetPivotLongTailTest, DistributedQueryComponentCustomSortTest, FacetPivotSmallTest, InfixSuggestersTest, ReplicaListTransformerTest, ShufflingReplicaListTransformerTest, SpatialHeatmapFacetsTest, TestLegacyFieldReuse, TestLegacyNumericUtils, TestLegacyTerms, TestNumericRangeQuery32, SolrMetricManagerTest, SolrMetricsIntegrationTest, SolrSlf4jReporterTest]
   [junit4] Completed [623/732 (4!)] on J1 in 6.39s, 1 test, 1 failure <<< FAILURES!

[...truncated 36951 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20373 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20373/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
count1=6, count2=6 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: count1=6, count2=6 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([C41C3A86B1E8D881:9BF817B1DAE44BC4]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:90)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping

Error Message:
Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.

Stack Trace:
java.lang.AssertionError: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
	at __randomizedtesting.SeedInfo.seed([C41C3A86B1E8D881:B5F8C450C703FF4D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11506 lines...]
   [junit4] Suite: org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_C41C3A86B1E8D881-001/init-core-data-001
   [junit4]   2> 907564 WARN  (SUITE-UpdateRequestProcessorFactoryTest-seed#[C41C3A86B1E8D881]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 907807 WARN  (coreLoadExecutor-3372-thread-1) [    x:collection1] o.a.s.c.RequestHandlers no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 907809 WARN  (coreLoadExecutor-3372-thread-1) [    x:collection1] o.a.s.r.ManagedResourceStorage Cannot write to config directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UpdateRequestProcessorFactoryTest -Dtests.method=testUpdateDistribChainSkipping -Dtests.seed=C41C3A86B1E8D881 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sv-SE -Dtests.timezone=Africa/Bangui -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.01s J1 | UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([C41C3A86B1E8D881:B5F8C450C703FF4D]:0)
   [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_C41C3A86B1E8D881-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=196, maxMBSortInHeap=5.685099151891312, sim=RandomSimilarity(queryNorm=true): {}, locale=sv-SE, timezone=Africa/Bangui
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=194224576,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [LukeRequestHandlerTest, TestAuthorizationFramework, TestUpdate, TestSimpleTrackingShardHandler, TestRestManager, TestRawResponseWriter, SolrMetricReporterTest, DistributedQueueTest, DataDrivenBlockJoinTest, SampleTest, TestConfigSetsAPIZkFailure, TolerantUpdateProcessorTest, TestPayloadScoreQParserPlugin, TestBlobHandler, CSVRequestHandlerTest, IndexSchemaRuntimeFieldTest, TestRTGBase, DistributedExpandComponentTest, IndexSchemaTest, ClusterStateUpdateTest, TestElisionMultitermQuery, TestDFISimilarityFactory, ConfigureRecoveryStrategyTest, ShardRoutingCustomTest, DeleteInactiveReplicaTest, TestSolrConfigHandler, TestTlogReplica, TestFuzzyAnalyzedSuggestions, TestQueryTypes, SliceStateTest, BitVectorTest, TestLeaderInitiatedRecoveryThread, TestValueSourceCache, TestConfigSetProperties, TestMaxTokenLenTokenizer, ForceLeaderTest, ClassificationUpdateProcessorTest, ShardRoutingTest, MetricUtilsTest, SaslZkACLProviderTest, CacheHeaderTest, TestFieldResource, TestLRUCache, StatelessScriptUpdateProcessorFactoryTest, TestSchemaVersionResource, SharedFSAutoReplicaFailoverUtilsTest, TestDocBasedVersionConstraints, ImplicitSnitchTest, DistributedMLTComponentTest, ConnectionManagerTest, SortSpecParsingTest, SolrGraphiteReporterTest, TestCollectionsAPIViaSolrCloudCluster, SchemaVersionSpecificBehaviorTest, DistributedSuggestComponentTest, TestSolrFieldCacheBean, TestStressCloudBlindAtomicUpdates, TestCloudPivotFacet, DeleteReplicaTest, OverseerModifyCollectionTest, TestScoreJoinQPNoScore, SystemInfoHandlerTest, ScriptEngineTest, TestSolrCLIRunExample, MetricsConfigTest, DocValuesMultiTest, CollectionsAPISolrJTest, TestSolrCoreSnapshots, TestHashPartitioner, DistribCursorPagingTest, TestSmileRequest, ExitableDirectoryReaderTest, TestDynamicFieldCollectionResource, TestMaxScoreQueryParser, FileBasedSpellCheckerTest, TlogReplayBufferedWhileIndexingTest, TestHashQParserPlugin, TestOrdValues, TestSQLHandler, SubstringBytesRefFilterTest, BadCopyFieldTest, MoreLikeThisHandlerTest, UpdateRequestProcessorFactoryTest]
   [junit4] Completed [244/732 (1!)] on J1 in 0.29s, 3 tests, 1 failure <<< FAILURES!

[...truncated 1259 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.metrics.reporters.SolrSlf4jReporterTest_C41C3A86B1E8D881-001/init-core-data-001
   [junit4]   2> 2872423 WARN  (SUITE-SolrSlf4jReporterTest-seed#[C41C3A86B1E8D881]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=6 numCloses=6
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=C41C3A86B1E8D881 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=tr -Dtests.timezone=Africa/Algiers -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 6.32s J0 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: count1=6, count2=6 - no 'solr.node' logs in: {numFound=0,start=0,docs=[]}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([C41C3A86B1E8D881:9BF817B1DAE44BC4]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:90)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.metrics.reporters.SolrSlf4jReporterTest_C41C3A86B1E8D881-001
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=false): {}, locale=tr, timezone=Africa/Algiers
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=159307368,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [JvmMetricsTest, TestSimpleTextCodec, TestMergePolicyConfig, SolrShardReporterTest, SolrPluginUtilsTest, SSLMigrationTest, TestPhraseSuggestions, DebugComponentTest, TestSchemaManager, BJQParserTest, NodeMutatorTest, TestXmlQParserPlugin, CoreAdminRequestStatusTest, HighlighterConfigTest, TestImpersonationWithHadoopAuth, TestEmbeddedSolrServerAdminHandler, SuggesterWFSTTest, TestLegacyNumericRangeQueryBuilder, RAMDirectoryFactoryTest, CustomCollectionTest, TestRandomDVFaceting, TestMultiWordSynonyms, TestPHPSerializedResponseWriter, TestSubQueryTransformerCrossCore, SpellCheckCollatorTest, TestNRTOpen, TestPushWriter, TestLockTree, TestBadConfig, TestSolrCoreParser, TestCustomSort, ReplicationFactorTest, TestUninvertingReader, IndexBasedSpellCheckerTest, TestBulkSchemaConcurrent, TestSolr4Spatial, TestManagedSchemaAPI, TestQuerySenderNoQuery, TestStressLiveNodes, TestLegacyTerms, TestReplicaProperties, TestSolrConfigHandlerCloud, DocValuesNotIndexedTest, TestImplicitCoreProperties, TestIndexingPerformance, TestIntervalFaceting, SolrGangliaReporterTest, SyncSliceTest, TestDocumentBuilder, TestRTimerTree, PluginInfoTest, TestFunctionQuery, AsyncCallRequestStatusResponseTest, TestUseDocValuesAsStored2, ChaosMonkeyNothingIsSafeTest, TestRestoreCore, TestHdfsBackupRestoreCore, BasicZkTest, SharedFSAutoReplicaFailoverTest, OpenExchangeRatesOrgProviderTest, TestCSVResponseWriter, AtomicUpdateProcessorFactoryTest, PeerSyncTest, SparseHLLTest, DistributedDebugComponentTest, TestCSVLoader, OverseerCollectionConfigSetProcessorTest, HdfsDirectoryTest, TestAuthenticationFramework, TestBinaryField, UpdateLogTest, TestDistributedSearch, TestCollationFieldDocValues, SpellingQueryConverterTest, CursorMarkTest, CdcrReplicationDistributedZkTest, TestCollapseQParserPlugin, TestMacros, RecoveryAfterSoftCommitTest, TestConfigSetImmutable, SolrRequestParserTest, SpatialHeatmapFacetsTest, TestSolrQueryParser, TestSimpleQParserPlugin, TestComponentsName, TestTolerantUpdateProcessorRandomCloud, TestSSLRandomization, RulesTest, SolrCoreTest, TestRandomCollapseQParserPlugin, TestStressLucene, TestRealTimeGet, HttpSolrCallGetCoreTest, TestHighlightDedupGrouping, CdcrUpdateLogTest, SolrCLIZkUtilsTest, HdfsChaosMonkeyNothingIsSafeTest, QueryResultKeyTest, TestClassicSimilarityFactory, TestSolrDeletionPolicy1, DistributedQueryComponentOptimizationTest, BigEndianAscendingWordSerializerTest, BasicDistributedZkTest, TestManagedResourceStorage, TestDeleteCollectionOnDownNodes, XmlUpdateRequestHandlerTest, TestSizeLimitedDistributedMap, TestFieldCollectionResource, CollectionsAPIAsyncDistributedZkTest, ChangedSchemaMergeTest, SearchHandlerTest, MoveReplicaHDFSUlogDirTest, SolrMetricManagerTest, TestSolrQueryResponse, TestFieldCacheSortRandom, OverseerStatusTest, DistributedFacetPivotLargeTest, TestPayloadCheckQParserPlugin, TestCloudSearcherWarming, TestDownShardTolerantSearch, TestHdfsCloudBackupRestore, TestOnReconnectListenerSupport, TestPrepRecovery, TestRandomFlRTGCloud, TestRebalanceLeaders, TestSegmentSorting, TestSolrCloudWithDelegationTokens, TestSolrCloudWithSecureImpersonation, TestTolerantUpdateProcessorCloud, VMParamsZkACLAndCredentialsProvidersTest, TestPolicyCloud, HdfsRecoverLeaseTest, HdfsTlogReplayBufferedWhileIndexingTest, HdfsUnloadDistributedZkTest, StressHdfsTest, BlobRepositoryCloudTest, CachingDirectoryFactoryTest, CoreSorterTest, DirectoryFactoryTest, TestBackupRepositoryFactory, TestConfigSets, TestCorePropertiesReload, TestInfoStreamLogging, TestReloadAndDeleteDocs, TestShardHandlerFactory, TestSolrXml, TestSolrCloudSnapshots, TestReqParamsAPI, TestSolrConfigHandlerConcurrent, DistributedQueryComponentCustomSortTest, ReplicaListTransformerTest, SuggestComponentContextFilterQueryTest, TestExpandComponent, TestHttpShardHandlerFactory, TestPivotHelperCode, TestTrackingShardHandlerFactory, TestLegacyField, TestLegacyFieldReuse, TestMultiValuedNumericRangeQuery, TestNumericRangeQuery32, TestNumericRangeQuery64, TestNumericTokenStream, SolrCoreMetricManagerTest, SolrJmxReporterTest, SolrSlf4jReporterTest]
   [junit4] Completed [617/732 (2!)] on J0 in 6.35s, 1 test, 1 failure <<< FAILURES!

[...truncated 43694 lines...]

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+181) - Build # 20372 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20372/
Java: 64bit/jdk-9-ea+181 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC --illegal-access=deny

14 tests failed.
FAILED:  org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec { seed=[65D03CA615D171A0:6EFB7DBE2A730CB1]}

Error Message:
expected:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=f9b499a2, testPoint=[lat=-0.5524688021969578, lon=-2.3897363373704286([X=-0.621758456273886, Y=-0.5813875749969153, Z=-0.5247903483212323])], testPointInSet=true, shapes={ {[lat=0.3441595658285148, lon=0.7971392811507088([X=0.6577805047912215, Y=0.673410898047286, Z=0.3374056459334281])], [lat=0.27284163898213365, lon=0.09786592361299984([X=0.9584010067289496, Y=0.09409539876194385, Z=0.2694690450362844])], [lat=0.7326304896509769, lon=0.8996817074352974([X=0.4623011417786432, Y=0.5821919191749783, Z=0.668827499103856])], [lat=0.009156315162334727, lon=0.48345699680854193([X=0.8853561420785631, Y=0.46482326310042615, Z=0.009156187221515457])], [lat=0.40361123599662896, lon=0.35742043560515724([X=0.8615291395396768, Y=0.3217472471544938, Z=0.3927419644913561])] {[lat=0.7856728881254853, lon=0.402183729276374([X=0.6505068258944671, Y=0.2767058813080986, Z=0.7073010142182846])], [lat=0.675068637104086, lon=0.33301623422920423([X=0.7377748837501578, Y=0.25519520488588776, Z=0.6249509007199615])], [lat=0.022008617071268888, lon=0.1296295899878469([X=0.9913696955649688, Y=0.12923554345738464, Z=0.02200684036148469])], [lat=0.5093093525412309, lon=0.2816606625583008([X=0.8386778400192653, Y=0.24267408740309512, Z=0.48757437172568313])], [lat=0.32219008519455483, lon=0.5437113108914912([X=0.8117590738728273, Y=0.490696783146679, Z=0.31664471098477354])], [lat=0.697349795636263, lon=0.20489679571079145([X=0.7505121727591579, Y=0.15596630136291087, Z=0.6421884391512366])], [lat=0.8233132161719019, lon=0.04899372518665479([X=0.678979301293312, Y=0.03329236772665358, Z=0.733402158891286])], [lat=0.38924861791732024, lon=0.6205566239974112([X=0.7526965024127337, Y=0.537989567049054, Z=0.37949334777043064])], [lat=0.3610379034700645, lon=0.7991684870398386([X=0.6523483207531128, Y=0.6705664366457359, Z=0.3532454139190403])], [lat=0.6640248021719264, lon=0.44186658235298215([X=0.7118810120738193, Y=0.33676443660343214, Z=0.6162914398950613])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=f9b461b0, testPoint=[lat=-0.5524688021969578, lon=-2.3897363373704286([X=-0.6217584562738862, Y=-0.5813875749969151, Z=-0.5247903483212324])], testPointInSet=false, shapes={ {[lat=0.3441595658285148, lon=0.7971392811507088([X=0.6577805047912215, Y=0.673410898047286, Z=0.3374056459334281])], [lat=0.27284163898213365, lon=0.09786592361299984([X=0.9584010067289496, Y=0.09409539876194385, Z=0.2694690450362844])], [lat=0.7326304896509769, lon=0.8996817074352974([X=0.4623011417786432, Y=0.5821919191749783, Z=0.668827499103856])], [lat=0.009156315162334727, lon=0.48345699680854193([X=0.8853561420785631, Y=0.46482326310042615, Z=0.009156187221515457])], [lat=0.40361123599662896, lon=0.35742043560515724([X=0.8615291395396768, Y=0.3217472471544938, Z=0.3927419644913561])] {[lat=0.7856728881254853, lon=0.402183729276374([X=0.6505068258944671, Y=0.2767058813080986, Z=0.7073010142182846])], [lat=0.675068637104086, lon=0.33301623422920423([X=0.7377748837501578, Y=0.25519520488588776, Z=0.6249509007199615])], [lat=0.022008617071268888, lon=0.1296295899878469([X=0.9913696955649688, Y=0.12923554345738464, Z=0.02200684036148469])], [lat=0.5093093525412309, lon=0.2816606625583008([X=0.8386778400192653, Y=0.24267408740309512, Z=0.48757437172568313])], [lat=0.32219008519455483, lon=0.5437113108914912([X=0.8117590738728273, Y=0.490696783146679, Z=0.31664471098477354])], [lat=0.697349795636263, lon=0.20489679571079145([X=0.7505121727591579, Y=0.15596630136291087, Z=0.6421884391512366])], [lat=0.8233132161719019, lon=0.04899372518665479([X=0.678979301293312, Y=0.03329236772665358, Z=0.733402158891286])], [lat=0.38924861791732024, lon=0.6205566239974112([X=0.7526965024127337, Y=0.537989567049054, Z=0.37949334777043064])], [lat=0.3610379034700645, lon=0.7991684870398386([X=0.6523483207531128, Y=0.6705664366457359, Z=0.3532454139190403])], [lat=0.6640248021719264, lon=0.44186658235298215([X=0.7118810120738193, Y=0.33676443660343214, Z=0.6162914398950613])]}}>

Stack Trace:
java.lang.AssertionError: expected:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=f9b499a2, testPoint=[lat=-0.5524688021969578, lon=-2.3897363373704286([X=-0.621758456273886, Y=-0.5813875749969153, Z=-0.5247903483212323])], testPointInSet=true, shapes={ {[lat=0.3441595658285148, lon=0.7971392811507088([X=0.6577805047912215, Y=0.673410898047286, Z=0.3374056459334281])], [lat=0.27284163898213365, lon=0.09786592361299984([X=0.9584010067289496, Y=0.09409539876194385, Z=0.2694690450362844])], [lat=0.7326304896509769, lon=0.8996817074352974([X=0.4623011417786432, Y=0.5821919191749783, Z=0.668827499103856])], [lat=0.009156315162334727, lon=0.48345699680854193([X=0.8853561420785631, Y=0.46482326310042615, Z=0.009156187221515457])], [lat=0.40361123599662896, lon=0.35742043560515724([X=0.8615291395396768, Y=0.3217472471544938, Z=0.3927419644913561])] {[lat=0.7856728881254853, lon=0.402183729276374([X=0.6505068258944671, Y=0.2767058813080986, Z=0.7073010142182846])], [lat=0.675068637104086, lon=0.33301623422920423([X=0.7377748837501578, Y=0.25519520488588776, Z=0.6249509007199615])], [lat=0.022008617071268888, lon=0.1296295899878469([X=0.9913696955649688, Y=0.12923554345738464, Z=0.02200684036148469])], [lat=0.5093093525412309, lon=0.2816606625583008([X=0.8386778400192653, Y=0.24267408740309512, Z=0.48757437172568313])], [lat=0.32219008519455483, lon=0.5437113108914912([X=0.8117590738728273, Y=0.490696783146679, Z=0.31664471098477354])], [lat=0.697349795636263, lon=0.20489679571079145([X=0.7505121727591579, Y=0.15596630136291087, Z=0.6421884391512366])], [lat=0.8233132161719019, lon=0.04899372518665479([X=0.678979301293312, Y=0.03329236772665358, Z=0.733402158891286])], [lat=0.38924861791732024, lon=0.6205566239974112([X=0.7526965024127337, Y=0.537989567049054, Z=0.37949334777043064])], [lat=0.3610379034700645, lon=0.7991684870398386([X=0.6523483207531128, Y=0.6705664366457359, Z=0.3532454139190403])], [lat=0.6640248021719264, lon=0.44186658235298215([X=0.7118810120738193, Y=0.33676443660343214, Z=0.6162914398950613])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=f9b461b0, testPoint=[lat=-0.5524688021969578, lon=-2.3897363373704286([X=-0.6217584562738862, Y=-0.5813875749969151, Z=-0.5247903483212324])], testPointInSet=false, shapes={ {[lat=0.3441595658285148, lon=0.7971392811507088([X=0.6577805047912215, Y=0.673410898047286, Z=0.3374056459334281])], [lat=0.27284163898213365, lon=0.09786592361299984([X=0.9584010067289496, Y=0.09409539876194385, Z=0.2694690450362844])], [lat=0.7326304896509769, lon=0.8996817074352974([X=0.4623011417786432, Y=0.5821919191749783, Z=0.668827499103856])], [lat=0.009156315162334727, lon=0.48345699680854193([X=0.8853561420785631, Y=0.46482326310042615, Z=0.009156187221515457])], [lat=0.40361123599662896, lon=0.35742043560515724([X=0.8615291395396768, Y=0.3217472471544938, Z=0.3927419644913561])] {[lat=0.7856728881254853, lon=0.402183729276374([X=0.6505068258944671, Y=0.2767058813080986, Z=0.7073010142182846])], [lat=0.675068637104086, lon=0.33301623422920423([X=0.7377748837501578, Y=0.25519520488588776, Z=0.6249509007199615])], [lat=0.022008617071268888, lon=0.1296295899878469([X=0.9913696955649688, Y=0.12923554345738464, Z=0.02200684036148469])], [lat=0.5093093525412309, lon=0.2816606625583008([X=0.8386778400192653, Y=0.24267408740309512, Z=0.48757437172568313])], [lat=0.32219008519455483, lon=0.5437113108914912([X=0.8117590738728273, Y=0.490696783146679, Z=0.31664471098477354])], [lat=0.697349795636263, lon=0.20489679571079145([X=0.7505121727591579, Y=0.15596630136291087, Z=0.6421884391512366])], [lat=0.8233132161719019, lon=0.04899372518665479([X=0.678979301293312, Y=0.03329236772665358, Z=0.733402158891286])], [lat=0.38924861791732024, lon=0.6205566239974112([X=0.7526965024127337, Y=0.537989567049054, Z=0.37949334777043064])], [lat=0.3610379034700645, lon=0.7991684870398386([X=0.6523483207531128, Y=0.6705664366457359, Z=0.3532454139190403])], [lat=0.6640248021719264, lon=0.44186658235298215([X=0.7118810120738193, Y=0.33676443660343214, Z=0.6162914398950613])]}}>
	at __randomizedtesting.SeedInfo.seed([65D03CA615D171A0:6EFB7DBE2A730CB1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec(RandomBinaryCodecTest.java:43)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec { seed=[65D03CA615D171A0:DFEC971DD549EEF7]}

Error Message:
expected:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=8281a116, testPoint=[lat=-0.15710125952637455, lon=-2.3730230897848408([X=-0.7107881743769937, Y=-0.6872587807274969, Z=-0.15661795853611815])], testPointInSet=true, shapes={ {[lat=0.641418212555765, lon=0.49685214775764197([X=0.7043059383975275, Y=0.38189029831473315, Z=0.5982805131607967])], [lat=0.257811332770965, lon=0.4529412691286292([X=0.8702289616844255, Y=0.42352984394834164, Z=0.2551942041127311])], [lat=0.29238497287432574, lon=0.7181757793642817([X=0.7216538211037711, Y=0.6306139824117613, Z=0.2884785390052975])], [lat=0.398541119005585, lon=0.7536618899585551([X=0.6724508031977848, Y=0.6310680772064318, Z=0.38831139441413615])], [lat=0.514678207221578, lon=0.8351036512448405([X=0.5843371651284757, Y=0.6455181154063596, Z=0.49240362771807594])], [lat=0.3330393286713236, lon=0.8730354345109141([X=0.60766049927518, Y=0.724727174709879, Z=0.32716482901007826])], [lat=0.23501802945547923, lon=0.9345368519608604([X=0.5783976467648668, Y=0.7829453499423125, Z=0.23307847178733299])], [lat=0.06636293129403859, lon=0.9872898049699329([X=0.5503477951613083, Y=0.8336181791494438, Z=0.06638744337217928])], [lat=0.18444900617323812, lon=0.5464075680924846([X=0.8407484288953458, Y=0.5113206918717532, Z=0.1835893085793851])] {[lat=0.337955072489864, lon=0.3918311344973384([X=0.8725853817121643, Y=0.36054971795799134, Z=0.33180660515995686])], [lat=0.20342468182937168, lon=0.06973573233078245([X=0.9779586468688284, Y=0.06830942957790748, Z=0.2022228010678423])], [lat=0.5337957441781677, lon=0.5342819550914476([X=0.7410874779740338, Y=0.4384892031403748, Z=0.5089301837639789])], [lat=0.39583318563571024, lon=0.8639259209746855([X=0.5996084898218182, Y=0.7020341975902694, Z=0.3858152499762914])], [lat=0.4704790563079593, lon=0.048144953672822566([X=0.8906979568581694, Y=0.04291577567640028, Z=0.45350660987187436])], [lat=0.37730038521210096, lon=0.8776854300069514([X=0.594385249218048, Y=0.7156271076479317, Z=0.36865571082470966])], [lat=0.8239740468806108, lon=0.8802080068028474([X=0.4324145049101711, Y=0.5232979285947883, Z=0.7333426823102793])], [lat=0.5799955931373573, lon=0.07683385916756125([X=0.8340867002703223, Y=0.06421250809056354, Z=0.5480790166832644])], [lat=0.03015054617273083, lon=0.270987355965739([X=0.9641437414882095, Y=0.2678597730571945, Z=0.030179614821519152])], [lat=0.8345700425655947, lon=0.169253657903086([X=0.6614190488491842, Y=0.1130289664004991, Z=0.7404681190085479])], [lat=0.05809996698888453, lon=0.27743027171961454([X=0.961202949052587, Y=0.2737257636793363, Z=0.05813159372223348])], [lat=0.21782688966760855, lon=0.34609368588626743([X=0.9193585336763713, Y=0.3315280067936641, Z=0.21631612989594176])], [lat=0.28716995590900285, lon=0.534530650652548([X=0.8259695220998715, Y=0.48898987405670724, Z=0.2834794900973043])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=82b5f306, testPoint=[lat=-0.15710125952637455, lon=-2.3730230897848408([X=-0.7107881743769936, Y=-0.687258780727497, Z=-0.15661795853611815])], testPointInSet=false, shapes={ {[lat=0.641418212555765, lon=0.49685214775764197([X=0.7043059383975275, Y=0.38189029831473315, Z=0.5982805131607967])], [lat=0.257811332770965, lon=0.4529412691286292([X=0.8702289616844255, Y=0.42352984394834164, Z=0.2551942041127311])], [lat=0.29238497287432574, lon=0.7181757793642817([X=0.7216538211037711, Y=0.6306139824117613, Z=0.2884785390052975])], [lat=0.398541119005585, lon=0.7536618899585551([X=0.6724508031977848, Y=0.6310680772064318, Z=0.38831139441413615])], [lat=0.514678207221578, lon=0.8351036512448405([X=0.5843371651284757, Y=0.6455181154063596, Z=0.49240362771807594])], [lat=0.3330393286713236, lon=0.8730354345109141([X=0.60766049927518, Y=0.724727174709879, Z=0.32716482901007826])], [lat=0.23501802945547923, lon=0.9345368519608604([X=0.5783976467648668, Y=0.7829453499423125, Z=0.23307847178733299])], [lat=0.06636293129403859, lon=0.9872898049699329([X=0.5503477951613083, Y=0.8336181791494438, Z=0.06638744337217928])], [lat=0.18444900617323812, lon=0.5464075680924846([X=0.8407484288953458, Y=0.5113206918717532, Z=0.1835893085793851])] {[lat=0.337955072489864, lon=0.3918311344973384([X=0.8725853817121643, Y=0.36054971795799134, Z=0.33180660515995686])], [lat=0.20342468182937168, lon=0.06973573233078245([X=0.9779586468688284, Y=0.06830942957790748, Z=0.2022228010678423])], [lat=0.5337957441781677, lon=0.5342819550914476([X=0.7410874779740338, Y=0.4384892031403748, Z=0.5089301837639789])], [lat=0.39583318563571024, lon=0.8639259209746855([X=0.5996084898218182, Y=0.7020341975902694, Z=0.3858152499762914])], [lat=0.4704790563079593, lon=0.048144953672822566([X=0.8906979568581694, Y=0.04291577567640028, Z=0.45350660987187436])], [lat=0.37730038521210096, lon=0.8776854300069514([X=0.594385249218048, Y=0.7156271076479317, Z=0.36865571082470966])], [lat=0.8239740468806108, lon=0.8802080068028474([X=0.4324145049101711, Y=0.5232979285947883, Z=0.7333426823102793])], [lat=0.5799955931373573, lon=0.07683385916756125([X=0.8340867002703223, Y=0.06421250809056354, Z=0.5480790166832644])], [lat=0.03015054617273083, lon=0.270987355965739([X=0.9641437414882095, Y=0.2678597730571945, Z=0.030179614821519152])], [lat=0.8345700425655947, lon=0.169253657903086([X=0.6614190488491842, Y=0.1130289664004991, Z=0.7404681190085479])], [lat=0.05809996698888453, lon=0.27743027171961454([X=0.961202949052587, Y=0.2737257636793363, Z=0.05813159372223348])], [lat=0.21782688966760855, lon=0.34609368588626743([X=0.9193585336763713, Y=0.3315280067936641, Z=0.21631612989594176])], [lat=0.28716995590900285, lon=0.534530650652548([X=0.8259695220998715, Y=0.48898987405670724, Z=0.2834794900973043])]}}>

Stack Trace:
java.lang.AssertionError: expected:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=8281a116, testPoint=[lat=-0.15710125952637455, lon=-2.3730230897848408([X=-0.7107881743769937, Y=-0.6872587807274969, Z=-0.15661795853611815])], testPointInSet=true, shapes={ {[lat=0.641418212555765, lon=0.49685214775764197([X=0.7043059383975275, Y=0.38189029831473315, Z=0.5982805131607967])], [lat=0.257811332770965, lon=0.4529412691286292([X=0.8702289616844255, Y=0.42352984394834164, Z=0.2551942041127311])], [lat=0.29238497287432574, lon=0.7181757793642817([X=0.7216538211037711, Y=0.6306139824117613, Z=0.2884785390052975])], [lat=0.398541119005585, lon=0.7536618899585551([X=0.6724508031977848, Y=0.6310680772064318, Z=0.38831139441413615])], [lat=0.514678207221578, lon=0.8351036512448405([X=0.5843371651284757, Y=0.6455181154063596, Z=0.49240362771807594])], [lat=0.3330393286713236, lon=0.8730354345109141([X=0.60766049927518, Y=0.724727174709879, Z=0.32716482901007826])], [lat=0.23501802945547923, lon=0.9345368519608604([X=0.5783976467648668, Y=0.7829453499423125, Z=0.23307847178733299])], [lat=0.06636293129403859, lon=0.9872898049699329([X=0.5503477951613083, Y=0.8336181791494438, Z=0.06638744337217928])], [lat=0.18444900617323812, lon=0.5464075680924846([X=0.8407484288953458, Y=0.5113206918717532, Z=0.1835893085793851])] {[lat=0.337955072489864, lon=0.3918311344973384([X=0.8725853817121643, Y=0.36054971795799134, Z=0.33180660515995686])], [lat=0.20342468182937168, lon=0.06973573233078245([X=0.9779586468688284, Y=0.06830942957790748, Z=0.2022228010678423])], [lat=0.5337957441781677, lon=0.5342819550914476([X=0.7410874779740338, Y=0.4384892031403748, Z=0.5089301837639789])], [lat=0.39583318563571024, lon=0.8639259209746855([X=0.5996084898218182, Y=0.7020341975902694, Z=0.3858152499762914])], [lat=0.4704790563079593, lon=0.048144953672822566([X=0.8906979568581694, Y=0.04291577567640028, Z=0.45350660987187436])], [lat=0.37730038521210096, lon=0.8776854300069514([X=0.594385249218048, Y=0.7156271076479317, Z=0.36865571082470966])], [lat=0.8239740468806108, lon=0.8802080068028474([X=0.4324145049101711, Y=0.5232979285947883, Z=0.7333426823102793])], [lat=0.5799955931373573, lon=0.07683385916756125([X=0.8340867002703223, Y=0.06421250809056354, Z=0.5480790166832644])], [lat=0.03015054617273083, lon=0.270987355965739([X=0.9641437414882095, Y=0.2678597730571945, Z=0.030179614821519152])], [lat=0.8345700425655947, lon=0.169253657903086([X=0.6614190488491842, Y=0.1130289664004991, Z=0.7404681190085479])], [lat=0.05809996698888453, lon=0.27743027171961454([X=0.961202949052587, Y=0.2737257636793363, Z=0.05813159372223348])], [lat=0.21782688966760855, lon=0.34609368588626743([X=0.9193585336763713, Y=0.3315280067936641, Z=0.21631612989594176])], [lat=0.28716995590900285, lon=0.534530650652548([X=0.8259695220998715, Y=0.48898987405670724, Z=0.2834794900973043])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=82b5f306, testPoint=[lat=-0.15710125952637455, lon=-2.3730230897848408([X=-0.7107881743769936, Y=-0.687258780727497, Z=-0.15661795853611815])], testPointInSet=false, shapes={ {[lat=0.641418212555765, lon=0.49685214775764197([X=0.7043059383975275, Y=0.38189029831473315, Z=0.5982805131607967])], [lat=0.257811332770965, lon=0.4529412691286292([X=0.8702289616844255, Y=0.42352984394834164, Z=0.2551942041127311])], [lat=0.29238497287432574, lon=0.7181757793642817([X=0.7216538211037711, Y=0.6306139824117613, Z=0.2884785390052975])], [lat=0.398541119005585, lon=0.7536618899585551([X=0.6724508031977848, Y=0.6310680772064318, Z=0.38831139441413615])], [lat=0.514678207221578, lon=0.8351036512448405([X=0.5843371651284757, Y=0.6455181154063596, Z=0.49240362771807594])], [lat=0.3330393286713236, lon=0.8730354345109141([X=0.60766049927518, Y=0.724727174709879, Z=0.32716482901007826])], [lat=0.23501802945547923, lon=0.9345368519608604([X=0.5783976467648668, Y=0.7829453499423125, Z=0.23307847178733299])], [lat=0.06636293129403859, lon=0.9872898049699329([X=0.5503477951613083, Y=0.8336181791494438, Z=0.06638744337217928])], [lat=0.18444900617323812, lon=0.5464075680924846([X=0.8407484288953458, Y=0.5113206918717532, Z=0.1835893085793851])] {[lat=0.337955072489864, lon=0.3918311344973384([X=0.8725853817121643, Y=0.36054971795799134, Z=0.33180660515995686])], [lat=0.20342468182937168, lon=0.06973573233078245([X=0.9779586468688284, Y=0.06830942957790748, Z=0.2022228010678423])], [lat=0.5337957441781677, lon=0.5342819550914476([X=0.7410874779740338, Y=0.4384892031403748, Z=0.5089301837639789])], [lat=0.39583318563571024, lon=0.8639259209746855([X=0.5996084898218182, Y=0.7020341975902694, Z=0.3858152499762914])], [lat=0.4704790563079593, lon=0.048144953672822566([X=0.8906979568581694, Y=0.04291577567640028, Z=0.45350660987187436])], [lat=0.37730038521210096, lon=0.8776854300069514([X=0.594385249218048, Y=0.7156271076479317, Z=0.36865571082470966])], [lat=0.8239740468806108, lon=0.8802080068028474([X=0.4324145049101711, Y=0.5232979285947883, Z=0.7333426823102793])], [lat=0.5799955931373573, lon=0.07683385916756125([X=0.8340867002703223, Y=0.06421250809056354, Z=0.5480790166832644])], [lat=0.03015054617273083, lon=0.270987355965739([X=0.9641437414882095, Y=0.2678597730571945, Z=0.030179614821519152])], [lat=0.8345700425655947, lon=0.169253657903086([X=0.6614190488491842, Y=0.1130289664004991, Z=0.7404681190085479])], [lat=0.05809996698888453, lon=0.27743027171961454([X=0.961202949052587, Y=0.2737257636793363, Z=0.05813159372223348])], [lat=0.21782688966760855, lon=0.34609368588626743([X=0.9193585336763713, Y=0.3315280067936641, Z=0.21631612989594176])], [lat=0.28716995590900285, lon=0.534530650652548([X=0.8259695220998715, Y=0.48898987405670724, Z=0.2834794900973043])]}}>
	at __randomizedtesting.SeedInfo.seed([65D03CA615D171A0:DFEC971DD549EEF7]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec(RandomBinaryCodecTest.java:43)
	at jdk.internal.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec { seed=[65D03CA615D171A0:678CAB2E00A22FD6]}

Error Message:
expected:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=1, address=907f534e, testPoint=[lat=-0.22480132780466655, lon=-2.3887590747204186([X=-0.7113926764910306, Y=-0.6665061072678364, Z=-0.2229126932446944])], testPointInSet=true, shapes={ {[lat=0.1917227404299534, lon=0.9216457305075011([X=0.5934338102375125, Y=0.7820018389430322, Z=0.19055035228701164])], [lat=0.055765974502701265, lon=0.8577564371162302([X=0.6531192251317495, Y=0.7552010700630568, Z=0.05573707508398183])], [lat=0.8072239574320569, lon=0.04986355807087517([X=0.6906469317810845, Y=0.034466683819163534, Z=0.7223703090021655])], [lat=0.8542343180240943, lon=0.026319137458077457([X=0.6565686114675595, Y=0.017284310650211132, Z=0.754068240307804])], [lat=0.7424926679371374, lon=0.29460334110545294([X=0.7050428496535037, Y=0.21393325837668042, Z=0.6761265718138902])], [lat=0.32406923668622223, lon=0.6344526006603616([X=0.7634734044347412, Y=0.5618833111163688, Z=0.3184266091420949])], [lat=0.5088462975449805, lon=0.05310195038351673([X=0.8720761440747062, Y=0.046352520870051706, Z=0.487170034736111])], [lat=0.3732377129388109, lon=0.9128120029855393([X=0.5694208754432614, Y=0.7367518370218658, Z=0.3646321396343663])], [lat=0.8028973933997032, lon=0.33639809802754594([X=0.6556913916915663, Y=0.22928833613073124, Z=0.7193717104362513])], [lat=0.06363597087551454, lon=0.01333042299019771([X=0.997887245858968, Y=0.013303047077765839, Z=0.0635930302033981])], [lat=0.5158803613108204, lon=0.023363762791674958([X=0.8696213743644844, Y=0.020321325213306058, Z=0.49330083011282344])], [lat=0.4534050613005173, lon=0.9901653475455262([X=0.49312640202324787, Y=0.7516361307448984, Z=0.4380290841787153])], [lat=0.14834731667354384, lon=0.7741243954307274([X=0.7071800089720415, Y=0.6914119398263061, Z=0.14780380365852522])], [lat=0.1299080092557957, lon=0.05174473008106473([X=0.990246632911595, Y=0.05128582579799387, Z=0.12954292755479477])], [lat=0.31040834919495763, lon=0.294485435744404([X=0.9112178685915606, Y=0.27637623516428617, Z=0.305447495645109])], [lat=0.5182890112347455, lon=0.846444819698547([X=0.5756228124427555, Y=0.6505709688623424, Z=0.49539458239771395])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=1, address=9082240e, testPoint=[lat=-0.22480132780466655, lon=-2.3887590747204186([X=-0.7113926764910308, Y=-0.6665061072678364, Z=-0.2229126932446944])], testPointInSet=false, shapes={ {[lat=0.1917227404299534, lon=0.9216457305075011([X=0.5934338102375125, Y=0.7820018389430322, Z=0.19055035228701164])], [lat=0.055765974502701265, lon=0.8577564371162302([X=0.6531192251317495, Y=0.7552010700630568, Z=0.05573707508398183])], [lat=0.8072239574320569, lon=0.04986355807087517([X=0.6906469317810845, Y=0.034466683819163534, Z=0.7223703090021655])], [lat=0.8542343180240943, lon=0.026319137458077457([X=0.6565686114675595, Y=0.017284310650211132, Z=0.754068240307804])], [lat=0.7424926679371374, lon=0.29460334110545294([X=0.7050428496535037, Y=0.21393325837668042, Z=0.6761265718138902])], [lat=0.32406923668622223, lon=0.6344526006603616([X=0.7634734044347412, Y=0.5618833111163688, Z=0.3184266091420949])], [lat=0.5088462975449805, lon=0.05310195038351673([X=0.8720761440747062, Y=0.046352520870051706, Z=0.487170034736111])], [lat=0.3732377129388109, lon=0.9128120029855393([X=0.5694208754432614, Y=0.7367518370218658, Z=0.3646321396343663])], [lat=0.8028973933997032, lon=0.33639809802754594([X=0.6556913916915663, Y=0.22928833613073124, Z=0.7193717104362513])], [lat=0.06363597087551454, lon=0.01333042299019771([X=0.997887245858968, Y=0.013303047077765839, Z=0.0635930302033981])], [lat=0.5158803613108204, lon=0.023363762791674958([X=0.8696213743644844, Y=0.020321325213306058, Z=0.49330083011282344])], [lat=0.4534050613005173, lon=0.9901653475455262([X=0.49312640202324787, Y=0.7516361307448984, Z=0.4380290841787153])], [lat=0.14834731667354384, lon=0.7741243954307274([X=0.7071800089720415, Y=0.6914119398263061, Z=0.14780380365852522])], [lat=0.1299080092557957, lon=0.05174473008106473([X=0.990246632911595, Y=0.05128582579799387, Z=0.12954292755479477])], [lat=0.31040834919495763, lon=0.294485435744404([X=0.9112178685915606, Y=0.27637623516428617, Z=0.305447495645109])], [lat=0.5182890112347455, lon=0.846444819698547([X=0.5756228124427555, Y=0.6505709688623424, Z=0.49539458239771395])]}}>

Stack Trace:
java.lang.AssertionError: expected:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=1, address=907f534e, testPoint=[lat=-0.22480132780466655, lon=-2.3887590747204186([X=-0.7113926764910306, Y=-0.6665061072678364, Z=-0.2229126932446944])], testPointInSet=true, shapes={ {[lat=0.1917227404299534, lon=0.9216457305075011([X=0.5934338102375125, Y=0.7820018389430322, Z=0.19055035228701164])], [lat=0.055765974502701265, lon=0.8577564371162302([X=0.6531192251317495, Y=0.7552010700630568, Z=0.05573707508398183])], [lat=0.8072239574320569, lon=0.04986355807087517([X=0.6906469317810845, Y=0.034466683819163534, Z=0.7223703090021655])], [lat=0.8542343180240943, lon=0.026319137458077457([X=0.6565686114675595, Y=0.017284310650211132, Z=0.754068240307804])], [lat=0.7424926679371374, lon=0.29460334110545294([X=0.7050428496535037, Y=0.21393325837668042, Z=0.6761265718138902])], [lat=0.32406923668622223, lon=0.6344526006603616([X=0.7634734044347412, Y=0.5618833111163688, Z=0.3184266091420949])], [lat=0.5088462975449805, lon=0.05310195038351673([X=0.8720761440747062, Y=0.046352520870051706, Z=0.487170034736111])], [lat=0.3732377129388109, lon=0.9128120029855393([X=0.5694208754432614, Y=0.7367518370218658, Z=0.3646321396343663])], [lat=0.8028973933997032, lon=0.33639809802754594([X=0.6556913916915663, Y=0.22928833613073124, Z=0.7193717104362513])], [lat=0.06363597087551454, lon=0.01333042299019771([X=0.997887245858968, Y=0.013303047077765839, Z=0.0635930302033981])], [lat=0.5158803613108204, lon=0.023363762791674958([X=0.8696213743644844, Y=0.020321325213306058, Z=0.49330083011282344])], [lat=0.4534050613005173, lon=0.9901653475455262([X=0.49312640202324787, Y=0.7516361307448984, Z=0.4380290841787153])], [lat=0.14834731667354384, lon=0.7741243954307274([X=0.7071800089720415, Y=0.6914119398263061, Z=0.14780380365852522])], [lat=0.1299080092557957, lon=0.05174473008106473([X=0.990246632911595, Y=0.05128582579799387, Z=0.12954292755479477])], [lat=0.31040834919495763, lon=0.294485435744404([X=0.9112178685915606, Y=0.27637623516428617, Z=0.305447495645109])], [lat=0.5182890112347455, lon=0.846444819698547([X=0.5756228124427555, Y=0.6505709688623424, Z=0.49539458239771395])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=1, address=9082240e, testPoint=[lat=-0.22480132780466655, lon=-2.3887590747204186([X=-0.7113926764910308, Y=-0.6665061072678364, Z=-0.2229126932446944])], testPointInSet=false, shapes={ {[lat=0.1917227404299534, lon=0.9216457305075011([X=0.5934338102375125, Y=0.7820018389430322, Z=0.19055035228701164])], [lat=0.055765974502701265, lon=0.8577564371162302([X=0.6531192251317495, Y=0.7552010700630568, Z=0.05573707508398183])], [lat=0.8072239574320569, lon=0.04986355807087517([X=0.6906469317810845, Y=0.034466683819163534, Z=0.7223703090021655])], [lat=0.8542343180240943, lon=0.026319137458077457([X=0.6565686114675595, Y=0.017284310650211132, Z=0.754068240307804])], [lat=0.7424926679371374, lon=0.29460334110545294([X=0.7050428496535037, Y=0.21393325837668042, Z=0.6761265718138902])], [lat=0.32406923668622223, lon=0.6344526006603616([X=0.7634734044347412, Y=0.5618833111163688, Z=0.3184266091420949])], [lat=0.5088462975449805, lon=0.05310195038351673([X=0.8720761440747062, Y=0.046352520870051706, Z=0.487170034736111])], [lat=0.3732377129388109, lon=0.9128120029855393([X=0.5694208754432614, Y=0.7367518370218658, Z=0.3646321396343663])], [lat=0.8028973933997032, lon=0.33639809802754594([X=0.6556913916915663, Y=0.22928833613073124, Z=0.7193717104362513])], [lat=0.06363597087551454, lon=0.01333042299019771([X=0.997887245858968, Y=0.013303047077765839, Z=0.0635930302033981])], [lat=0.5158803613108204, lon=0.023363762791674958([X=0.8696213743644844, Y=0.020321325213306058, Z=0.49330083011282344])], [lat=0.4534050613005173, lon=0.9901653475455262([X=0.49312640202324787, Y=0.7516361307448984, Z=0.4380290841787153])], [lat=0.14834731667354384, lon=0.7741243954307274([X=0.7071800089720415, Y=0.6914119398263061, Z=0.14780380365852522])], [lat=0.1299080092557957, lon=0.05174473008106473([X=0.990246632911595, Y=0.05128582579799387, Z=0.12954292755479477])], [lat=0.31040834919495763, lon=0.294485435744404([X=0.9112178685915606, Y=0.27637623516428617, Z=0.305447495645109])], [lat=0.5182890112347455, lon=0.846444819698547([X=0.5756228124427555, Y=0.6505709688623424, Z=0.49539458239771395])]}}>
	at __randomizedtesting.SeedInfo.seed([65D03CA615D171A0:678CAB2E00A22FD6]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec(RandomBinaryCodecTest.java:43)
	at jdk.internal.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec { seed=[65D03CA615D171A0:3D6C8422B1F419D8]}

Error Message:
expected:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=b04d804c, testPoint=[lat=0.458681642600358, lon=0.5977950722238998([X=0.7411409600786114, Y=0.5046463996979701, Z=0.44276640406158946])], testPointInSet=true, shapes={ {[lat=0.7621504164132287, lon=0.05078296954173456([X=0.7224203374385865, Y=0.036718219748552494, Z=0.6904785502777157])], [lat=0.08302484742863125, lon=0.9884569373999472([X=0.5480847979320973, Y=0.8323014795298861, Z=0.08292949685181282])], [lat=0.6462184298900916, lon=0.6449730363522415([X=0.6379875502911473, Y=0.47995958454150084, Z=0.6021716390533938])], [lat=0.13006170754483826, lon=0.3508691346520939([X=0.9311428108735186, Y=0.34081107279009726, Z=0.12969532922286056])], [lat=0.3549852169297023, lon=0.9960861219579276([X=0.5096995238590151, Y=0.7870177693749193, Z=0.34757650390384515])] {[lat=0.31890356201575143, lon=0.8263770001647465([X=0.6433828695883893, Y=0.6983982997140092, Z=0.3135255939740655])], [lat=0.6287998796904173, lon=0.9615706189730122([X=0.4627839763126996, Y=0.6632357249509939, Z=0.5881746036823897])], [lat=0.5086399841718887, lon=0.7417739977442973([X=0.6439383013727418, Y=0.5900714792120664, Z=0.4869898494277596])], [lat=0.47021165926006947, lon=0.8381560836273316([X=0.59624772691569, Y=0.6627304935614778, Z=0.45307498391726836])], [lat=0.6015316132221816, lon=0.07456176454329677([X=0.8221790927030085, Y=0.06141698114462499, Z=0.5659059055612855])], [lat=0.9618287252550377, lon=0.5207772001488801([X=0.4961897027040988, Y=0.2846115739133502, Z=0.8202390084146106])], [lat=0.3320212874118059, lon=0.907461167342727([X=0.5821193630794812, Y=0.7449098289639934, Z=0.32595458861745347])], [lat=0.026951319878786073, lon=0.5562888462696477([X=0.8489121785994241, Y=0.5278464883261308, Z=0.026948057209215913])], [lat=0.08469708428050171, lon=0.10198754654369124([X=0.9912377488404571, Y=0.10144587859112024, Z=0.08459585681686135])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=b04d9ad1, testPoint=[lat=0.458681642600358, lon=0.5977950722238998([X=0.7411409600786114, Y=0.5046463996979702, Z=0.44276640406158957])], testPointInSet=false, shapes={ {[lat=0.7621504164132287, lon=0.05078296954173456([X=0.7224203374385865, Y=0.036718219748552494, Z=0.6904785502777157])], [lat=0.08302484742863125, lon=0.9884569373999472([X=0.5480847979320973, Y=0.8323014795298861, Z=0.08292949685181282])], [lat=0.6462184298900916, lon=0.6449730363522415([X=0.6379875502911473, Y=0.47995958454150084, Z=0.6021716390533938])], [lat=0.13006170754483826, lon=0.3508691346520939([X=0.9311428108735186, Y=0.34081107279009726, Z=0.12969532922286056])], [lat=0.3549852169297023, lon=0.9960861219579276([X=0.5096995238590151, Y=0.7870177693749193, Z=0.34757650390384515])] {[lat=0.31890356201575143, lon=0.8263770001647465([X=0.6433828695883893, Y=0.6983982997140092, Z=0.3135255939740655])], [lat=0.6287998796904173, lon=0.9615706189730122([X=0.4627839763126996, Y=0.6632357249509939, Z=0.5881746036823897])], [lat=0.5086399841718887, lon=0.7417739977442973([X=0.6439383013727418, Y=0.5900714792120664, Z=0.4869898494277596])], [lat=0.47021165926006947, lon=0.8381560836273316([X=0.59624772691569, Y=0.6627304935614778, Z=0.45307498391726836])], [lat=0.6015316132221816, lon=0.07456176454329677([X=0.8221790927030085, Y=0.06141698114462499, Z=0.5659059055612855])], [lat=0.9618287252550377, lon=0.5207772001488801([X=0.4961897027040988, Y=0.2846115739133502, Z=0.8202390084146106])], [lat=0.3320212874118059, lon=0.907461167342727([X=0.5821193630794812, Y=0.7449098289639934, Z=0.32595458861745347])], [lat=0.026951319878786073, lon=0.5562888462696477([X=0.8489121785994241, Y=0.5278464883261308, Z=0.026948057209215913])], [lat=0.08469708428050171, lon=0.10198754654369124([X=0.9912377488404571, Y=0.10144587859112024, Z=0.08459585681686135])]}}>

Stack Trace:
java.lang.AssertionError: expected:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=b04d804c, testPoint=[lat=0.458681642600358, lon=0.5977950722238998([X=0.7411409600786114, Y=0.5046463996979701, Z=0.44276640406158946])], testPointInSet=true, shapes={ {[lat=0.7621504164132287, lon=0.05078296954173456([X=0.7224203374385865, Y=0.036718219748552494, Z=0.6904785502777157])], [lat=0.08302484742863125, lon=0.9884569373999472([X=0.5480847979320973, Y=0.8323014795298861, Z=0.08292949685181282])], [lat=0.6462184298900916, lon=0.6449730363522415([X=0.6379875502911473, Y=0.47995958454150084, Z=0.6021716390533938])], [lat=0.13006170754483826, lon=0.3508691346520939([X=0.9311428108735186, Y=0.34081107279009726, Z=0.12969532922286056])], [lat=0.3549852169297023, lon=0.9960861219579276([X=0.5096995238590151, Y=0.7870177693749193, Z=0.34757650390384515])] {[lat=0.31890356201575143, lon=0.8263770001647465([X=0.6433828695883893, Y=0.6983982997140092, Z=0.3135255939740655])], [lat=0.6287998796904173, lon=0.9615706189730122([X=0.4627839763126996, Y=0.6632357249509939, Z=0.5881746036823897])], [lat=0.5086399841718887, lon=0.7417739977442973([X=0.6439383013727418, Y=0.5900714792120664, Z=0.4869898494277596])], [lat=0.47021165926006947, lon=0.8381560836273316([X=0.59624772691569, Y=0.6627304935614778, Z=0.45307498391726836])], [lat=0.6015316132221816, lon=0.07456176454329677([X=0.8221790927030085, Y=0.06141698114462499, Z=0.5659059055612855])], [lat=0.9618287252550377, lon=0.5207772001488801([X=0.4961897027040988, Y=0.2846115739133502, Z=0.8202390084146106])], [lat=0.3320212874118059, lon=0.907461167342727([X=0.5821193630794812, Y=0.7449098289639934, Z=0.32595458861745347])], [lat=0.026951319878786073, lon=0.5562888462696477([X=0.8489121785994241, Y=0.5278464883261308, Z=0.026948057209215913])], [lat=0.08469708428050171, lon=0.10198754654369124([X=0.9912377488404571, Y=0.10144587859112024, Z=0.08459585681686135])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=b04d9ad1, testPoint=[lat=0.458681642600358, lon=0.5977950722238998([X=0.7411409600786114, Y=0.5046463996979702, Z=0.44276640406158957])], testPointInSet=false, shapes={ {[lat=0.7621504164132287, lon=0.05078296954173456([X=0.7224203374385865, Y=0.036718219748552494, Z=0.6904785502777157])], [lat=0.08302484742863125, lon=0.9884569373999472([X=0.5480847979320973, Y=0.8323014795298861, Z=0.08292949685181282])], [lat=0.6462184298900916, lon=0.6449730363522415([X=0.6379875502911473, Y=0.47995958454150084, Z=0.6021716390533938])], [lat=0.13006170754483826, lon=0.3508691346520939([X=0.9311428108735186, Y=0.34081107279009726, Z=0.12969532922286056])], [lat=0.3549852169297023, lon=0.9960861219579276([X=0.5096995238590151, Y=0.7870177693749193, Z=0.34757650390384515])] {[lat=0.31890356201575143, lon=0.8263770001647465([X=0.6433828695883893, Y=0.6983982997140092, Z=0.3135255939740655])], [lat=0.6287998796904173, lon=0.9615706189730122([X=0.4627839763126996, Y=0.6632357249509939, Z=0.5881746036823897])], [lat=0.5086399841718887, lon=0.7417739977442973([X=0.6439383013727418, Y=0.5900714792120664, Z=0.4869898494277596])], [lat=0.47021165926006947, lon=0.8381560836273316([X=0.59624772691569, Y=0.6627304935614778, Z=0.45307498391726836])], [lat=0.6015316132221816, lon=0.07456176454329677([X=0.8221790927030085, Y=0.06141698114462499, Z=0.5659059055612855])], [lat=0.9618287252550377, lon=0.5207772001488801([X=0.4961897027040988, Y=0.2846115739133502, Z=0.8202390084146106])], [lat=0.3320212874118059, lon=0.907461167342727([X=0.5821193630794812, Y=0.7449098289639934, Z=0.32595458861745347])], [lat=0.026951319878786073, lon=0.5562888462696477([X=0.8489121785994241, Y=0.5278464883261308, Z=0.026948057209215913])], [lat=0.08469708428050171, lon=0.10198754654369124([X=0.9912377488404571, Y=0.10144587859112024, Z=0.08459585681686135])]}}>
	at __randomizedtesting.SeedInfo.seed([65D03CA615D171A0:3D6C8422B1F419D8]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec(RandomBinaryCodecTest.java:43)
	at jdk.internal.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec { seed=[65D03CA615D171A0:46217C3486984697]}

Error Message:
expected:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=2d5542e5, testPoint=[lat=-0.28425958249566163, lon=-2.3417772461321835([X=-0.6694456301396835, Y=-0.6890324979705603, Z=-0.2806862220438076])], testPointInSet=true, shapes={ {[lat=0.8245082860125134, lon=0.14062631951497873([X=0.6717490306152557, Y=0.09509326907570083, Z=0.7337039281456962])], [lat=0.524430794190223, lon=0.6617468612462883([X=0.6830835147458238, Y=0.5320590635400662, Z=0.5008576299405892])], [lat=0.7353360362563726, lon=0.3182927021714944([X=0.7040765187615905, Y=0.23199017368165245, Z=0.6705708443751798])], [lat=0.37050074111485154, lon=0.6708668171494848([X=0.7306285227602388, Y=0.5798750420236839, Z=0.362327322619618])], [lat=0.7583865598458551, lon=0.9471970507227276([X=0.423723806336399, Y=0.5890315425893052, Z=0.6874257489892703])], [lat=0.7004090876837242, lon=0.12334259519067159([X=0.758557853733459, Y=0.09403986722993557, Z=0.6443502869757964])], [lat=0.0794039745430537, lon=0.9067105368474712([X=0.6150718616442367, Y=0.7858609912188519, Z=0.07940762519074267])], [lat=0.4955354960523308, lon=0.43668333756207056([X=0.7974458376401998, Y=0.3721959472047019, Z=0.4756725394476307])], [lat=0.35360100185828236, lon=0.4809494961342142([X=0.8323008062290551, Y=0.43430977918646835, Z=0.3465257050648751])] {[lat=0.7119608769814507, lon=0.49390136458651335([X=0.6663914531871965, Y=0.35879177989505173, Z=0.6531118457244022])], [lat=0.8128958647047263, lon=0.5746866558631307([X=0.5765978754476184, Y=0.37340515768528426, Z=0.72580446695871])], [lat=0.7521029103742114, lon=0.5292521703290732([X=0.6300591722499965, Y=0.3685297336576195, Z=0.6828671587033489])], [lat=0.1835986727655503, lon=0.9416783426348591([X=0.579124355561586, Y=0.7957576948780025, Z=0.18275268066454659])], [lat=0.1585660665321479, lon=0.18452158788284456([X=0.9716962527234347, Y=0.18136197347859787, Z=0.15806581492447086])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=2d56420a, testPoint=[lat=-0.28425958249566163, lon=-2.3417772461321835([X=-0.6694456301396837, Y=-0.6890324979705603, Z=-0.28068622204380766])], testPointInSet=false, shapes={ {[lat=0.8245082860125134, lon=0.14062631951497873([X=0.6717490306152557, Y=0.09509326907570083, Z=0.7337039281456962])], [lat=0.524430794190223, lon=0.6617468612462883([X=0.6830835147458238, Y=0.5320590635400662, Z=0.5008576299405892])], [lat=0.7353360362563726, lon=0.3182927021714944([X=0.7040765187615905, Y=0.23199017368165245, Z=0.6705708443751798])], [lat=0.37050074111485154, lon=0.6708668171494848([X=0.7306285227602388, Y=0.5798750420236839, Z=0.362327322619618])], [lat=0.7583865598458551, lon=0.9471970507227276([X=0.423723806336399, Y=0.5890315425893052, Z=0.6874257489892703])], [lat=0.7004090876837242, lon=0.12334259519067159([X=0.758557853733459, Y=0.09403986722993557, Z=0.6443502869757964])], [lat=0.0794039745430537, lon=0.9067105368474712([X=0.6150718616442367, Y=0.7858609912188519, Z=0.07940762519074267])], [lat=0.4955354960523308, lon=0.43668333756207056([X=0.7974458376401998, Y=0.3721959472047019, Z=0.4756725394476307])], [lat=0.35360100185828236, lon=0.4809494961342142([X=0.8323008062290551, Y=0.43430977918646835, Z=0.3465257050648751])] {[lat=0.7119608769814507, lon=0.49390136458651335([X=0.6663914531871965, Y=0.35879177989505173, Z=0.6531118457244022])], [lat=0.8128958647047263, lon=0.5746866558631307([X=0.5765978754476184, Y=0.37340515768528426, Z=0.72580446695871])], [lat=0.7521029103742114, lon=0.5292521703290732([X=0.6300591722499965, Y=0.3685297336576195, Z=0.6828671587033489])], [lat=0.1835986727655503, lon=0.9416783426348591([X=0.579124355561586, Y=0.7957576948780025, Z=0.18275268066454659])], [lat=0.1585660665321479, lon=0.18452158788284456([X=0.9716962527234347, Y=0.18136197347859787, Z=0.15806581492447086])]}}>

Stack Trace:
java.lang.AssertionError: expected:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=2d5542e5, testPoint=[lat=-0.28425958249566163, lon=-2.3417772461321835([X=-0.6694456301396835, Y=-0.6890324979705603, Z=-0.2806862220438076])], testPointInSet=true, shapes={ {[lat=0.8245082860125134, lon=0.14062631951497873([X=0.6717490306152557, Y=0.09509326907570083, Z=0.7337039281456962])], [lat=0.524430794190223, lon=0.6617468612462883([X=0.6830835147458238, Y=0.5320590635400662, Z=0.5008576299405892])], [lat=0.7353360362563726, lon=0.3182927021714944([X=0.7040765187615905, Y=0.23199017368165245, Z=0.6705708443751798])], [lat=0.37050074111485154, lon=0.6708668171494848([X=0.7306285227602388, Y=0.5798750420236839, Z=0.362327322619618])], [lat=0.7583865598458551, lon=0.9471970507227276([X=0.423723806336399, Y=0.5890315425893052, Z=0.6874257489892703])], [lat=0.7004090876837242, lon=0.12334259519067159([X=0.758557853733459, Y=0.09403986722993557, Z=0.6443502869757964])], [lat=0.0794039745430537, lon=0.9067105368474712([X=0.6150718616442367, Y=0.7858609912188519, Z=0.07940762519074267])], [lat=0.4955354960523308, lon=0.43668333756207056([X=0.7974458376401998, Y=0.3721959472047019, Z=0.4756725394476307])], [lat=0.35360100185828236, lon=0.4809494961342142([X=0.8323008062290551, Y=0.43430977918646835, Z=0.3465257050648751])] {[lat=0.7119608769814507, lon=0.49390136458651335([X=0.6663914531871965, Y=0.35879177989505173, Z=0.6531118457244022])], [lat=0.8128958647047263, lon=0.5746866558631307([X=0.5765978754476184, Y=0.37340515768528426, Z=0.72580446695871])], [lat=0.7521029103742114, lon=0.5292521703290732([X=0.6300591722499965, Y=0.3685297336576195, Z=0.6828671587033489])], [lat=0.1835986727655503, lon=0.9416783426348591([X=0.579124355561586, Y=0.7957576948780025, Z=0.18275268066454659])], [lat=0.1585660665321479, lon=0.18452158788284456([X=0.9716962527234347, Y=0.18136197347859787, Z=0.15806581492447086])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=2d56420a, testPoint=[lat=-0.28425958249566163, lon=-2.3417772461321835([X=-0.6694456301396837, Y=-0.6890324979705603, Z=-0.28068622204380766])], testPointInSet=false, shapes={ {[lat=0.8245082860125134, lon=0.14062631951497873([X=0.6717490306152557, Y=0.09509326907570083, Z=0.7337039281456962])], [lat=0.524430794190223, lon=0.6617468612462883([X=0.6830835147458238, Y=0.5320590635400662, Z=0.5008576299405892])], [lat=0.7353360362563726, lon=0.3182927021714944([X=0.7040765187615905, Y=0.23199017368165245, Z=0.6705708443751798])], [lat=0.37050074111485154, lon=0.6708668171494848([X=0.7306285227602388, Y=0.5798750420236839, Z=0.362327322619618])], [lat=0.7583865598458551, lon=0.9471970507227276([X=0.423723806336399, Y=0.5890315425893052, Z=0.6874257489892703])], [lat=0.7004090876837242, lon=0.12334259519067159([X=0.758557853733459, Y=0.09403986722993557, Z=0.6443502869757964])], [lat=0.0794039745430537, lon=0.9067105368474712([X=0.6150718616442367, Y=0.7858609912188519, Z=0.07940762519074267])], [lat=0.4955354960523308, lon=0.43668333756207056([X=0.7974458376401998, Y=0.3721959472047019, Z=0.4756725394476307])], [lat=0.35360100185828236, lon=0.4809494961342142([X=0.8323008062290551, Y=0.43430977918646835, Z=0.3465257050648751])] {[lat=0.7119608769814507, lon=0.49390136458651335([X=0.6663914531871965, Y=0.35879177989505173, Z=0.6531118457244022])], [lat=0.8128958647047263, lon=0.5746866558631307([X=0.5765978754476184, Y=0.37340515768528426, Z=0.72580446695871])], [lat=0.7521029103742114, lon=0.5292521703290732([X=0.6300591722499965, Y=0.3685297336576195, Z=0.6828671587033489])], [lat=0.1835986727655503, lon=0.9416783426348591([X=0.579124355561586, Y=0.7957576948780025, Z=0.18275268066454659])], [lat=0.1585660665321479, lon=0.18452158788284456([X=0.9716962527234347, Y=0.18136197347859787, Z=0.15806581492447086])]}}>
	at __randomizedtesting.SeedInfo.seed([65D03CA615D171A0:46217C3486984697]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec(RandomBinaryCodecTest.java:43)
	at jdk.internal.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec { seed=[65D03CA615D171A0:282B7E284C8B259D]}

Error Message:
expected:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=f62373f3, testPoint=[lat=0.5478364212158696, lon=0.3829663418986104([X=0.7919772674475607, Y=0.319053091479595, Z=0.5209482509235501])], testPointInSet=true, shapes={ {[lat=0.6161219837737695, lon=0.024196174094404777([X=0.815881974046969, Y=0.019745075718317514, Z=0.5778712152646861])], [lat=0.31741535337215565, lon=0.2198305280728211([X=0.9279147315723223, Y=0.2073346425880838, Z=0.3123587641344983])], [lat=0.27823595446100025, lon=0.36025458181007697([X=0.9005951785538975, Y=0.339248377123162, Z=0.27489730618780633])], [lat=0.5683383471189533, lon=0.4065608094995382([X=0.7742077158766189, Y=0.3333339111772189, Z=0.5383093214037281])], [lat=0.6255493304473284, lon=0.593636996531003([X=0.6719262489141471, Y=0.45344002677602857, Z=0.5855217143894417])], [lat=0.3728578678860821, lon=0.7795745488864407([X=0.6627900852678589, Y=0.6551150271655476, Z=0.36452303013239473])], [lat=0.7722725893878566, lon=0.17273315536470557([X=0.7053002382058982, Y=0.1230550307243706, Z=0.6974023971075051])], [lat=0.5441202922350775, lon=0.077303495427403([X=0.8532121753014674, Y=0.0660879794862565, Z=0.5177774689809508])], [lat=0.14189322492885603, lon=0.655908485712871([X=0.7853544995928139, Y=0.6043849768087364, Z=0.14156625063853165])], [lat=0.7777146321127998, lon=0.36653178057191893([X=0.6648327195154716, Y=0.2552150103459405, Z=0.7012754910674323])] {[lat=0.8934213068206567, lon=0.6331301427309556([X=0.5048062808399113, Y=0.37048735694128554, Z=0.7785012072966064])], [lat=0.6755531612519461, lon=0.6192414147761579([X=0.6353372722889798, Y=0.4528457998026988, Z=0.6252054421868516])], [lat=0.6091033811275584, lon=0.9610583730858384([X=0.46967526932904585, Y=0.672377738521811, Z=0.5721417042700447])], [lat=0.5057692626900159, lon=0.23075404304284297([X=0.8518940157609356, Y=0.20014303018888288, Z=0.484639424104512])], [lat=0.5673966628288837, lon=0.5797851643565326([X=0.7055936103674721, Y=0.4620660470701932, Z=0.5375168649024681])], [lat=0.4892259423912446, lon=0.7079078348035632([X=0.6708572192827433, Y=0.574184919624088, Z=0.4701188375878553])], [lat=0.38710607387258567, lon=0.18676564099887205([X=0.9104830338384935, Y=0.1720520877263948, Z=0.37775122090485946])], [lat=0.0524781528479219, lon=0.6424453989746634([X=0.8004179158039613, Y=0.5989941543026374, Z=0.05251227064532341])], [lat=0.7310991123839524, lon=0.0849005982266825([X=0.7414764581523408, Y=0.0631034867685178, Z=0.6674334019624546])], [lat=0.25311237231497863, lon=0.2510094757385115([X=0.9386493211061411, Y=0.24068610466885673, Z=0.2506455943749441])], [lat=0.2452438737115128, lon=0.3487670011307389([X=0.9125131717065158, Y=0.3318188362968243, Z=0.243016290109275])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=f623046c, testPoint=[lat=0.5478364212158696, lon=0.3829663418986104([X=0.7919772674475606, Y=0.31905309147959504, Z=0.52094825092355])], testPointInSet=false, shapes={ {[lat=0.6161219837737695, lon=0.024196174094404777([X=0.815881974046969, Y=0.019745075718317514, Z=0.5778712152646861])], [lat=0.31741535337215565, lon=0.2198305280728211([X=0.9279147315723223, Y=0.2073346425880838, Z=0.3123587641344983])], [lat=0.27823595446100025, lon=0.36025458181007697([X=0.9005951785538975, Y=0.339248377123162, Z=0.27489730618780633])], [lat=0.5683383471189533, lon=0.4065608094995382([X=0.7742077158766189, Y=0.3333339111772189, Z=0.5383093214037281])], [lat=0.6255493304473284, lon=0.593636996531003([X=0.6719262489141471, Y=0.45344002677602857, Z=0.5855217143894417])], [lat=0.3728578678860821, lon=0.7795745488864407([X=0.6627900852678589, Y=0.6551150271655476, Z=0.36452303013239473])], [lat=0.7722725893878566, lon=0.17273315536470557([X=0.7053002382058982, Y=0.1230550307243706, Z=0.6974023971075051])], [lat=0.5441202922350775, lon=0.077303495427403([X=0.8532121753014674, Y=0.0660879794862565, Z=0.5177774689809508])], [lat=0.14189322492885603, lon=0.655908485712871([X=0.7853544995928139, Y=0.6043849768087364, Z=0.14156625063853165])], [lat=0.7777146321127998, lon=0.36653178057191893([X=0.6648327195154716, Y=0.2552150103459405, Z=0.7012754910674323])] {[lat=0.8934213068206567, lon=0.6331301427309556([X=0.5048062808399113, Y=0.37048735694128554, Z=0.7785012072966064])], [lat=0.6755531612519461, lon=0.6192414147761579([X=0.6353372722889798, Y=0.4528457998026988, Z=0.6252054421868516])], [lat=0.6091033811275584, lon=0.9610583730858384([X=0.46967526932904585, Y=0.672377738521811, Z=0.5721417042700447])], [lat=0.5057692626900159, lon=0.23075404304284297([X=0.8518940157609356, Y=0.20014303018888288, Z=0.484639424104512])], [lat=0.5673966628288837, lon=0.5797851643565326([X=0.7055936103674721, Y=0.4620660470701932, Z=0.5375168649024681])], [lat=0.4892259423912446, lon=0.7079078348035632([X=0.6708572192827433, Y=0.574184919624088, Z=0.4701188375878553])], [lat=0.38710607387258567, lon=0.18676564099887205([X=0.9104830338384935, Y=0.1720520877263948, Z=0.37775122090485946])], [lat=0.0524781528479219, lon=0.6424453989746634([X=0.8004179158039613, Y=0.5989941543026374, Z=0.05251227064532341])], [lat=0.7310991123839524, lon=0.0849005982266825([X=0.7414764581523408, Y=0.0631034867685178, Z=0.6674334019624546])], [lat=0.25311237231497863, lon=0.2510094757385115([X=0.9386493211061411, Y=0.24068610466885673, Z=0.2506455943749441])], [lat=0.2452438737115128, lon=0.3487670011307389([X=0.9125131717065158, Y=0.3318188362968243, Z=0.243016290109275])]}}>

Stack Trace:
java.lang.AssertionError: expected:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=f62373f3, testPoint=[lat=0.5478364212158696, lon=0.3829663418986104([X=0.7919772674475607, Y=0.319053091479595, Z=0.5209482509235501])], testPointInSet=true, shapes={ {[lat=0.6161219837737695, lon=0.024196174094404777([X=0.815881974046969, Y=0.019745075718317514, Z=0.5778712152646861])], [lat=0.31741535337215565, lon=0.2198305280728211([X=0.9279147315723223, Y=0.2073346425880838, Z=0.3123587641344983])], [lat=0.27823595446100025, lon=0.36025458181007697([X=0.9005951785538975, Y=0.339248377123162, Z=0.27489730618780633])], [lat=0.5683383471189533, lon=0.4065608094995382([X=0.7742077158766189, Y=0.3333339111772189, Z=0.5383093214037281])], [lat=0.6255493304473284, lon=0.593636996531003([X=0.6719262489141471, Y=0.45344002677602857, Z=0.5855217143894417])], [lat=0.3728578678860821, lon=0.7795745488864407([X=0.6627900852678589, Y=0.6551150271655476, Z=0.36452303013239473])], [lat=0.7722725893878566, lon=0.17273315536470557([X=0.7053002382058982, Y=0.1230550307243706, Z=0.6974023971075051])], [lat=0.5441202922350775, lon=0.077303495427403([X=0.8532121753014674, Y=0.0660879794862565, Z=0.5177774689809508])], [lat=0.14189322492885603, lon=0.655908485712871([X=0.7853544995928139, Y=0.6043849768087364, Z=0.14156625063853165])], [lat=0.7777146321127998, lon=0.36653178057191893([X=0.6648327195154716, Y=0.2552150103459405, Z=0.7012754910674323])] {[lat=0.8934213068206567, lon=0.6331301427309556([X=0.5048062808399113, Y=0.37048735694128554, Z=0.7785012072966064])], [lat=0.6755531612519461, lon=0.6192414147761579([X=0.6353372722889798, Y=0.4528457998026988, Z=0.6252054421868516])], [lat=0.6091033811275584, lon=0.9610583730858384([X=0.46967526932904585, Y=0.672377738521811, Z=0.5721417042700447])], [lat=0.5057692626900159, lon=0.23075404304284297([X=0.8518940157609356, Y=0.20014303018888288, Z=0.484639424104512])], [lat=0.5673966628288837, lon=0.5797851643565326([X=0.7055936103674721, Y=0.4620660470701932, Z=0.5375168649024681])], [lat=0.4892259423912446, lon=0.7079078348035632([X=0.6708572192827433, Y=0.574184919624088, Z=0.4701188375878553])], [lat=0.38710607387258567, lon=0.18676564099887205([X=0.9104830338384935, Y=0.1720520877263948, Z=0.37775122090485946])], [lat=0.0524781528479219, lon=0.6424453989746634([X=0.8004179158039613, Y=0.5989941543026374, Z=0.05251227064532341])], [lat=0.7310991123839524, lon=0.0849005982266825([X=0.7414764581523408, Y=0.0631034867685178, Z=0.6674334019624546])], [lat=0.25311237231497863, lon=0.2510094757385115([X=0.9386493211061411, Y=0.24068610466885673, Z=0.2506455943749441])], [lat=0.2452438737115128, lon=0.3487670011307389([X=0.9125131717065158, Y=0.3318188362968243, Z=0.243016290109275])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.WGS84, number of shapes=2, address=f623046c, testPoint=[lat=0.5478364212158696, lon=0.3829663418986104([X=0.7919772674475606, Y=0.31905309147959504, Z=0.52094825092355])], testPointInSet=false, shapes={ {[lat=0.6161219837737695, lon=0.024196174094404777([X=0.815881974046969, Y=0.019745075718317514, Z=0.5778712152646861])], [lat=0.31741535337215565, lon=0.2198305280728211([X=0.9279147315723223, Y=0.2073346425880838, Z=0.3123587641344983])], [lat=0.27823595446100025, lon=0.36025458181007697([X=0.9005951785538975, Y=0.339248377123162, Z=0.27489730618780633])], [lat=0.5683383471189533, lon=0.4065608094995382([X=0.7742077158766189, Y=0.3333339111772189, Z=0.5383093214037281])], [lat=0.6255493304473284, lon=0.593636996531003([X=0.6719262489141471, Y=0.45344002677602857, Z=0.5855217143894417])], [lat=0.3728578678860821, lon=0.7795745488864407([X=0.6627900852678589, Y=0.6551150271655476, Z=0.36452303013239473])], [lat=0.7722725893878566, lon=0.17273315536470557([X=0.7053002382058982, Y=0.1230550307243706, Z=0.6974023971075051])], [lat=0.5441202922350775, lon=0.077303495427403([X=0.8532121753014674, Y=0.0660879794862565, Z=0.5177774689809508])], [lat=0.14189322492885603, lon=0.655908485712871([X=0.7853544995928139, Y=0.6043849768087364, Z=0.14156625063853165])], [lat=0.7777146321127998, lon=0.36653178057191893([X=0.6648327195154716, Y=0.2552150103459405, Z=0.7012754910674323])] {[lat=0.8934213068206567, lon=0.6331301427309556([X=0.5048062808399113, Y=0.37048735694128554, Z=0.7785012072966064])], [lat=0.6755531612519461, lon=0.6192414147761579([X=0.6353372722889798, Y=0.4528457998026988, Z=0.6252054421868516])], [lat=0.6091033811275584, lon=0.9610583730858384([X=0.46967526932904585, Y=0.672377738521811, Z=0.5721417042700447])], [lat=0.5057692626900159, lon=0.23075404304284297([X=0.8518940157609356, Y=0.20014303018888288, Z=0.484639424104512])], [lat=0.5673966628288837, lon=0.5797851643565326([X=0.7055936103674721, Y=0.4620660470701932, Z=0.5375168649024681])], [lat=0.4892259423912446, lon=0.7079078348035632([X=0.6708572192827433, Y=0.574184919624088, Z=0.4701188375878553])], [lat=0.38710607387258567, lon=0.18676564099887205([X=0.9104830338384935, Y=0.1720520877263948, Z=0.37775122090485946])], [lat=0.0524781528479219, lon=0.6424453989746634([X=0.8004179158039613, Y=0.5989941543026374, Z=0.05251227064532341])], [lat=0.7310991123839524, lon=0.0849005982266825([X=0.7414764581523408, Y=0.0631034867685178, Z=0.6674334019624546])], [lat=0.25311237231497863, lon=0.2510094757385115([X=0.9386493211061411, Y=0.24068610466885673, Z=0.2506455943749441])], [lat=0.2452438737115128, lon=0.3487670011307389([X=0.9125131717065158, Y=0.3318188362968243, Z=0.243016290109275])]}}>
	at __randomizedtesting.SeedInfo.seed([65D03CA615D171A0:282B7E284C8B259D]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:147)
	at org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec(RandomBinaryCodecTest.java:43)
	at jdk.internal.reflect.GeneratedMethodAccessor3.invoke(Unknown Source)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.lucene.spatial3d.geom.RandomBinaryCodecTest.testRandomShapeCodec { seed=[65D03CA615D171A0:E16CD1B3E7E169D8]}

Error Message:
expected:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=8fbb1148, testPoint=[lat=-0.21474781290178788, lon=-2.8838474909340466([X=-0.9447561203868474, Y=-0.24904581798108363, Z=-0.21310104067724678])], testPointInSet=true, shapes={ {[lat=0.6105004365050369, lon=0.05714421422296578([X=0.8180237992738654, Y=0.04679627545842728, Z=0.5732775701392562])], [lat=0.7242779499816445, lon=0.34764285100976966([X=0.7041729516140565, Y=0.255163798878756, Z=0.6625948158240521])], [lat=0.8504839119544504, lon=0.7626406054926582([X=0.47691435252271663, Y=0.45568695943599147, Z=0.7515996908979001])], [lat=0.9898937813542898, lon=0.5988690780581394([X=0.45327671398678854, Y=0.3093513167384457, Z=0.8359676927905342])], [lat=0.19132772707808732, lon=0.5476954265089075([X=0.8381485474300387, Y=0.5112193389855957, Z=0.19016256174138788])], [lat=0.12216644300819135, lon=0.912488329267845([X=0.6072196883965512, Y=0.785132925640123, Z=0.12186278800099877])], [lat=0.8691050049937626, lon=0.43442299238829707([X=0.5855508699090969, Y=0.27168695760872413, Z=0.7637515144430257])], [lat=0.7778483028846194, lon=0.7078418705475472([X=0.5412770013875459, Y=0.4632156963967486, Z=0.7017481217506619])], [lat=0.2747487872668236, lon=0.04957127456615673([X=0.9613110525348412, Y=0.047692485623870746, Z=0.27130515492591195])], [lat=0.4134915354370633, lon=0.3032383635720661([X=0.873943116678082, Y=0.27344636553808177, Z=0.40180905164644337])], [lat=0.024197420002894487, lon=0.23453635129096373([X=0.9723374655332464, Y=0.23232402426924495, Z=0.024195058746084012])] {[lat=0.7279637634071335, lon=0.43506640435303134([X=0.6769854907057952, Y=0.3146407830679041, Z=0.6653509021593417])], [lat=0.7503211827503119, lon=0.06876758019709495([X=0.7297410287072295, Y=0.050261778687645295, Z=0.6818737307042035])], [lat=0.7224024558905583, lon=0.5152833486703008([X=0.6528057738458989, Y=0.3696941944927604, Z=0.6611889474210881])], [lat=0.7952870562744411, lon=0.014322992203739782([X=0.7000080093681491, Y=0.010026894936280433, Z=0.7140645966566176])], [lat=0.36272869062793567, lon=0.8751571248109633([X=0.5991757740397552, Y=0.7176952074421069, Z=0.35482669152487867])], [lat=0.057594256171425884, lon=0.873589789407206([X=0.6410139937853075, Y=0.7653676420645874, Z=0.057562420483362256])], [lat=0.3602371922823965, lon=0.7900501921117044([X=0.6586343993000972, Y=0.6647910569365894, Z=0.3524962108671986])], [lat=0.7321809438275519, lon=0.06631380370937001([X=0.7420835671403779, Y=0.04928264567734899, Z=0.6684932312411647])], [lat=0.6498120355126777, lon=0.4036362617560717([X=0.7322142127661637, Y=0.31271850952681857, Z=0.6050367595630468])], [lat=0.029940327785116905, lon=0.46365239270588277([X=0.8940241899022764, Y=0.4470174408989948, Z=0.029935854784727198])], [lat=0.9179357355550376, lon=0.6897915910441489([X=0.46858260299900917, Y=0.38657399014178667, Z=0.7943493528118033])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=8fbc6e65, testPoint=[lat=-0.21474781290178788, lon=-2.8838474909340466([X=-0.9447561203868475, Y=-0.24904581798108358, Z=-0.21310104067724678])], testPointInSet=false, shapes={ {[lat=0.6105004365050369, lon=0.05714421422296578([X=0.8180237992738654, Y=0.04679627545842728, Z=0.5732775701392562])], [lat=0.7242779499816445, lon=0.34764285100976966([X=0.7041729516140565, Y=0.255163798878756, Z=0.6625948158240521])], [lat=0.8504839119544504, lon=0.7626406054926582([X=0.47691435252271663, Y=0.45568695943599147, Z=0.7515996908979001])], [lat=0.9898937813542898, lon=0.5988690780581394([X=0.45327671398678854, Y=0.3093513167384457, Z=0.8359676927905342])], [lat=0.19132772707808732, lon=0.5476954265089075([X=0.8381485474300387, Y=0.5112193389855957, Z=0.19016256174138788])], [lat=0.12216644300819135, lon=0.912488329267845([X=0.6072196883965512, Y=0.785132925640123, Z=0.12186278800099877])], [lat=0.8691050049937626, lon=0.43442299238829707([X=0.5855508699090969, Y=0.27168695760872413, Z=0.7637515144430257])], [lat=0.7778483028846194, lon=0.7078418705475472([X=0.5412770013875459, Y=0.4632156963967486, Z=0.7017481217506619])], [lat=0.2747487872668236, lon=0.04957127456615673([X=0.9613110525348412, Y=0.047692485623870746, Z=0.27130515492591195])], [lat=0.4134915354370633, lon=0.3032383635720661([X=0.873943116678082, Y=0.27344636553808177, Z=0.40180905164644337])], [lat=0.024197420002894487, lon=0.23453635129096373([X=0.9723374655332464, Y=0.23232402426924495, Z=0.024195058746084012])] {[lat=0.7279637634071335, lon=0.43506640435303134([X=0.6769854907057952, Y=0.3146407830679041, Z=0.6653509021593417])], [lat=0.7503211827503119, lon=0.06876758019709495([X=0.7297410287072295, Y=0.050261778687645295, Z=0.6818737307042035])], [lat=0.7224024558905583, lon=0.5152833486703008([X=0.6528057738458989, Y=0.3696941944927604, Z=0.6611889474210881])], [lat=0.7952870562744411, lon=0.014322992203739782([X=0.7000080093681491, Y=0.010026894936280433, Z=0.7140645966566176])], [lat=0.36272869062793567, lon=0.8751571248109633([X=0.5991757740397552, Y=0.7176952074421069, Z=0.35482669152487867])], [lat=0.057594256171425884, lon=0.873589789407206([X=0.6410139937853075, Y=0.7653676420645874, Z=0.057562420483362256])], [lat=0.3602371922823965, lon=0.7900501921117044([X=0.6586343993000972, Y=0.6647910569365894, Z=0.3524962108671986])], [lat=0.7321809438275519, lon=0.06631380370937001([X=0.7420835671403779, Y=0.04928264567734899, Z=0.6684932312411647])], [lat=0.6498120355126777, lon=0.4036362617560717([X=0.7322142127661637, Y=0.31271850952681857, Z=0.6050367595630468])], [lat=0.029940327785116905, lon=0.46365239270588277([X=0.8940241899022764, Y=0.4470174408989948, Z=0.029935854784727198])], [lat=0.9179357355550376, lon=0.6897915910441489([X=0.46858260299900917, Y=0.38657399014178667, Z=0.7943493528118033])]}}>

Stack Trace:
java.lang.AssertionError: expected:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=8fbb1148, testPoint=[lat=-0.21474781290178788, lon=-2.8838474909340466([X=-0.9447561203868474, Y=-0.24904581798108363, Z=-0.21310104067724678])], testPointInSet=true, shapes={ {[lat=0.6105004365050369, lon=0.05714421422296578([X=0.8180237992738654, Y=0.04679627545842728, Z=0.5732775701392562])], [lat=0.7242779499816445, lon=0.34764285100976966([X=0.7041729516140565, Y=0.255163798878756, Z=0.6625948158240521])], [lat=0.8504839119544504, lon=0.7626406054926582([X=0.47691435252271663, Y=0.45568695943599147, Z=0.7515996908979001])], [lat=0.9898937813542898, lon=0.5988690780581394([X=0.45327671398678854, Y=0.3093513167384457, Z=0.8359676927905342])], [lat=0.19132772707808732, lon=0.5476954265089075([X=0.8381485474300387, Y=0.5112193389855957, Z=0.19016256174138788])], [lat=0.12216644300819135, lon=0.912488329267845([X=0.6072196883965512, Y=0.785132925640123, Z=0.12186278800099877])], [lat=0.8691050049937626, lon=0.43442299238829707([X=0.5855508699090969, Y=0.27168695760872413, Z=0.7637515144430257])], [lat=0.7778483028846194, lon=0.7078418705475472([X=0.5412770013875459, Y=0.4632156963967486, Z=0.7017481217506619])], [lat=0.2747487872668236, lon=0.04957127456615673([X=0.9613110525348412, Y=0.047692485623870746, Z=0.27130515492591195])], [lat=0.4134915354370633, lon=0.3032383635720661([X=0.873943116678082, Y=0.27344636553808177, Z=0.40180905164644337])], [lat=0.024197420002894487, lon=0.23453635129096373([X=0.9723374655332464, Y=0.23232402426924495, Z=0.024195058746084012])] {[lat=0.7279637634071335, lon=0.43506640435303134([X=0.6769854907057952, Y=0.3146407830679041, Z=0.6653509021593417])], [lat=0.7503211827503119, lon=0.06876758019709495([X=0.7297410287072295, Y=0.050261778687645295, Z=0.6818737307042035])], [lat=0.7224024558905583, lon=0.5152833486703008([X=0.6528057738458989, Y=0.3696941944927604, Z=0.6611889474210881])], [lat=0.7952870562744411, lon=0.014322992203739782([X=0.7000080093681491, Y=0.010026894936280433, Z=0.7140645966566176])], [lat=0.36272869062793567, lon=0.8751571248109633([X=0.5991757740397552, Y=0.7176952074421069, Z=0.35482669152487867])], [lat=0.057594256171425884, lon=0.873589789407206([X=0.6410139937853075, Y=0.7653676420645874, Z=0.057562420483362256])], [lat=0.3602371922823965, lon=0.7900501921117044([X=0.6586343993000972, Y=0.6647910569365894, Z=0.3524962108671986])], [lat=0.7321809438275519, lon=0.06631380370937001([X=0.7420835671403779, Y=0.04928264567734899, Z=0.6684932312411647])], [lat=0.6498120355126777, lon=0.4036362617560717([X=0.7322142127661637, Y=0.31271850952681857, Z=0.6050367595630468])], [lat=0.029940327785116905, lon=0.46365239270588277([X=0.8940241899022764, Y=0.4470174408989948, Z=0.029935854784727198])], [lat=0.9179357355550376, lon=0.6897915910441489([X=0.46858260299900917, Y=0.38657399014178667, Z=0.7943493528118033])]}}> but was:<GeoComplexPolygon: {planetmodel=PlanetModel.SPHERE, number of shapes=2, address=8fbc6e65, testPoint=[lat=-0.21474781290178788, lon=-2.8838474909340466([X=-0.9447561203868475, Y=-0.24904581798108358, Z=-0.21310104067724678])], testPointInSet=false, shapes={ {[lat=0.6105004365050369, lon=0.05714421422296578([X=0.8180237992738654, Y=0.04679627545842728, Z=0.5732775701392562])], [lat=0.7242779499816445, lon=0.34764285100976966([X=0.7041729516140565, Y=0.255163798878756, Z=0.6625948158240521])], [lat=0.8504839119544504, lon=0.7626406054926582([X=0.47691435252271663, Y=0.45568695943599147, Z=0.7515996908979001])], [lat=0.9898937813542898, lon=0.5988690780581394([X=0.45327671398678854, Y=0.3093513167384457, Z=0.8359676927905342])], [lat=0.19132772707808732, lon=0.5476954265089075([X=0.8381485474300387, Y=0.5112193389855957, Z=0.19016256174138788])], [lat=0.12216644300819135, lon=0.912488329267845([X=0.6072196883965512, Y=0.785132925640123, Z=0.12186278800099877])], [lat=0.8691050049937626, lon=0.43442299238829707([X=0.5855508699090969, Y=0.27168695760872413, Z=0.7637515144430257])], [lat=0.7778483028846194, lon=0.7078418705475472([X=0.5412770013875459, Y=0.4632156963967486, Z=0.7017481217506619])], [lat=0.2747487872668236, lon=0.04957127456615673([X=0.9613110525348412, Y=0.047692485623870746, Z=0.27130515492591195])], [lat=0.4134915354370633, lon=0.3032383635720661([X=0.873943116678082, Y=0.27344636553808177, Z=0.40180905164644337])], [lat=0.024197420002894487, lon=0.23453635129096373([X=0.9723374655332464, Y=0.23232402426924495, Z=0.024195058746084012])] {[lat=0.7279637634071335, lon=0.43506640435303134([X=0.6769854907057952, Y=0.3146407830679041, Z=0.6653509021593417])], [lat=0.7503211827503119, lon=0.06876758019709495([X=0.7297410287072295, Y=0.050261778687645295, Z=0.6818737307042035])], [lat=0.7224024558905583, lon=0.5152833486703008([X=0.6528057738458989, Y=0.3696941944927604, Z=0.6611889474210881])], [lat=0.7952870562744411, lon=0.014322992203739782([X=0.7000080093681491, Y=0.010026894936280433, Z=0.7140645966566176])], [lat=0.36272869062793567, lon=0.8751571248109633([X=0.5991757740397552, Y=0.7176952074421069, Z=0.35482669152487867])], [lat=0.057594256171425884, lon=0.873589789407206([X=0.6410139937853075, Y=0.7653676420645874, Z=0.057562420483362256])], [lat=0.3602371922823965, lon=0.7900501921117044([X=0.6586343993000972, Y=0.6647910569365894, Z=0.3524962108671986])], [lat=0.7321809438275519, lon=0.06631380370937001([X=0.7420835671403779, Y=0.04928264567734899, Z=0.6684932312411647])], [lat=0.6498120355126777, lon=0.4036362617560717([X=0.7322142127661637, Y=0.3127185

[...truncated too long message...]

kspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J1-20170825_163424_86417072678213714092006.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J2-20170825_163424_8641531042829229295834.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 499 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20170825_163503_64214587594295280057556.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20170825_163503_64213719389274557925244.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20170825_163503_6422838902742511822577.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1131 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20170825_163520_75113397034884119012216.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20170825_163520_7514424386072778838977.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 593 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20170825_163527_2558580686436660529580.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20170825_163527_2547304036836004622809.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20170825_163527_25411657477078130714688.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 503 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20170825_163549_792585272004853583266.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20170825_163549_7923525074273586625623.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20170825_163549_79213022864225679274427.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 507 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20170825_163600_28716406652032210621044.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20170825_163600_2879862911101128570835.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 592 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20170825_163606_2306011476076282390033.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20170825_163606_23015619596877960706934.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20170825_163606_23015744884729814294900.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 538 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20170825_163633_71012233368777520345914.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20170825_163633_7097349877661817436738.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 494 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20170825_163643_1975344668297297533519.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 28973 lines...]

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+181) - Build # 20371 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20371/
Java: 64bit/jdk-9-ea+181 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC --illegal-access=deny

1 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Doc with id=1 not found in http://127.0.0.1:41895/qzx/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:41895/qzx/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([202F446799C7A621:A87B7BBD373BCBD9]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1696 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J1-20170825_093120_9807402049014997267882.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J0-20170825_093120_97815888931782499005347.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J2-20170825_093120_98514994651576037397879.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 285 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J0-20170825_093727_9786554943164977157386.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J2-20170825_093727_97813101292385864567785.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J1-20170825_093727_97815340951858200878374.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 1033 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20170825_093859_68716519114680521290076.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20170825_093859_687264152141095146537.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20170825_093859_6876237338003244335635.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 218 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20170825_094048_9679954270482970236696.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20170825_094048_96712308377558298323997.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20170825_094048_96716541597067028242294.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 231 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20170825_094101_56317127374111585986394.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20170825_094101_5637981496275347178413.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 12 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20170825_094101_56311621133551310285198.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 146 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20170825_094124_74715778643075487932772.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20170825_094124_74716467416038863943748.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20170825_094124_7478267548674806476527.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 155 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20170825_094128_73315731587673985354054.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20170825_094128_73011196041281467741504.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20170825_094128_7338089745019165516211.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 145 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20170825_094138_3707976831794267933110.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20170825_094138_3707944408880210667694.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 146 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20170825_094145_5563981920008896931664.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20170825_094145_55918329452347756906836.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20170825_094145_556581583489287460152.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 161 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20170825_094148_2569699902338905085995.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 145 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20170825_094155_0156054359433221772417.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20170825_094155_0175467816067083907598.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 25 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20170825_094155_0134995330685063715582.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1209 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J2-20170825_094205_9851041027037286478148.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J1-20170825_094205_9858078021788570165236.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J0-20170825_094205_9857344641255459283097.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 220 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J2-20170825_094214_95112679811942449591727.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J1-20170825_094214_94915533988415257938714.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J0-20170825_094214_94910576556705856202169.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 250 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J0-20170825_094225_9466619161392769875733.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J1-20170825_094225_9464081978667633566065.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20170825_094225_94612650130151577761694.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 229 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J1-20170825_094436_1124319846349486351466.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J0-20170825_094436_1126306566605674081462.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J2-20170825_094436_1129080088502885910302.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 159 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J2-20170825_094438_7139554186765955255549.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J1-20170825_094438_71317866056317087233583.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J0-20170825_094438_7135158853011716211309.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 204 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J0-20170825_094443_5846193795809675082686.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J2-20170825_094443_58415356144725795218495.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J1-20170825_094443_5842870754645829575446.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 171 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J1-20170825_094513_24111971761335357472378.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J2-20170825_094513_24114942512181372262637.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J0-20170825_094513_24114299896515574284211.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 235 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J1-20170825_094524_67116315947484615627587.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J2-20170825_094524_67114157467639203130392.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J0-20170825_094524_67113995432602279757866.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 152 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J2-20170825_094543_78113738274536352321266.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J0-20170825_094543_7811471915712677597208.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J1-20170825_094543_78117742375093796110219.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 141 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J0-20170825_094604_9248590799297718596988.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J1-20170825_094604_92413962740043582746127.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 164 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J1-20170825_094615_43810370244895105137506.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J2-20170825_094615_43811439833650779919019.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J0-20170825_094615_43814153111871069186172.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 304 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J2-20170825_094632_52111422717094936583211.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J1-20170825_094632_52116662874337295299743.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J0-20170825_094632_5211330657675387221038.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 222 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J2-20170825_094640_5966299459839155386567.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J0-20170825_094640_57510203620360146639812.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J1-20170825_094640_57515434481089996491358.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 199 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J1-20170825_094649_7803049534052532583898.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J2-20170825_094649_7808316386268836152071.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J0-20170825_094649_78011217230943805245457.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 200 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J1-20170825_094701_46314926481690670607066.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J0-20170825_094701_4637218951613402229333.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 7 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J2-20170825_094701_46312596885465359730606.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 210 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20170825_094752_3786894281434355028053.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20170825_094752_3786034612462965319737.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20170825_094752_37818227010686398448846.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 140 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial/test/temp/junit4-J0-20170825_094806_97818357998587569892749.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 163 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20170825_094808_7794486250478778291080.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20170825_094808_77913131001892493873648.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20170825_094808_77914093632598691317967.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 242 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J0-20170825_094907_2339408223775438305949.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J2-20170825_094907_23317366601403367452762.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J1-20170825_094907_23310320431264304475898.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 1647 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> 253247 INFO  (SUITE-HttpPartitionTest-seed#[202F446799C7A621]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/init-core-data-001
   [junit4]   2> 253247 WARN  (SUITE-HttpPartitionTest-seed#[202F446799C7A621]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=16 numCloses=16
   [junit4]   2> 253247 INFO  (SUITE-HttpPartitionTest-seed#[202F446799C7A621]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 253247 INFO  (SUITE-HttpPartitionTest-seed#[202F446799C7A621]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl="https://issues.apache.org/jira/browse/SOLR-5776")
   [junit4]   2> 253247 INFO  (SUITE-HttpPartitionTest-seed#[202F446799C7A621]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /qzx/
   [junit4]   2> 253248 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 253248 INFO  (Thread-603) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 253248 INFO  (Thread-603) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 253249 ERROR (Thread-603) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 253348 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.ZkTestServer start zk server on port:45549
   [junit4]   2> 253354 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 253354 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 253355 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 253355 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 253356 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 253356 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 253356 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 253357 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 253357 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 253358 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 253358 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 253358 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 253396 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=778419196
   [junit4]   2> 253396 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=972724807
   [junit4]   2> 253396 ERROR (Finalizer) [    ] o.a.s.c.CoreContainer CoreContainer was not close prior to finalize(), indicates a bug -- POSSIBLE RESOURCE LEAK!!!  instance=877865273
   [junit4]   2> 253424 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 253424 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4d936c7a{/qzx,null,AVAILABLE}
   [junit4]   2> 253425 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@39b6eb06{HTTP/1.1,[http/1.1]}{127.0.0.1:32937}
   [junit4]   2> 253425 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.Server Started @255142ms
   [junit4]   2> 253425 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/qzx, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/tempDir-001/control/data, hostPort=41659, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/control-001/cores, replicaType=NRT}
   [junit4]   2> 253425 ERROR (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 253425 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 253425 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 253425 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 253425 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-25T09:54:14.422900Z
   [junit4]   2> 253427 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 253427 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/control-001/solr.xml
   [junit4]   2> 253429 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 253430 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45549/solr
   [junit4]   2> 253458 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 253459 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41659_qzx
   [junit4]   2> 253459 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.Overseer Overseer (id=98543524527865860-127.0.0.1:41659_qzx-n_0000000000) starting
   [junit4]   2> 253461 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41659_qzx
   [junit4]   2> 253461 INFO  (zkCallback-813-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 253490 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 253495 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 253495 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 253496 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/control-001/cores
   [junit4]   2> 253507 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 253507 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45549/solr ready
   [junit4]   2> 253507 INFO  (SocketProxy-Acceptor-41659) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=41670,localport=41659], receiveBufferSize:531000
   [junit4]   2> 253509 INFO  (SocketProxy-Acceptor-41659) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=32937,localport=35468], receiveBufferSize=530904
   [junit4]   2> 253510 INFO  (qtp1776167937-3456) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:41659_qzx&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 253511 INFO  (OverseerThreadFactory-1339-thread-1) [    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 253613 INFO  (SocketProxy-Acceptor-41659) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=41674,localport=41659], receiveBufferSize:531000
   [junit4]   2> 253614 INFO  (SocketProxy-Acceptor-41659) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=32937,localport=35472], receiveBufferSize=530904
   [junit4]   2> 253614 INFO  (qtp1776167937-3458) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 253614 INFO  (qtp1776167937-3458) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 253716 INFO  (zkCallback-813-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 254621 INFO  (qtp1776167937-3458) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 254634 INFO  (qtp1776167937-3458) [    ] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 254686 INFO  (qtp1776167937-3458) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 254694 INFO  (qtp1776167937-3458) [    ] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 254695 INFO  (qtp1776167937-3458) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 254695 INFO  (qtp1776167937-3458) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 254695 INFO  (qtp1776167937-3458) [    ] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 254697 INFO  (qtp1776167937-3458) [    ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1144995934, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 254698 WARN  (qtp1776167937-3458) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 254727 INFO  (qtp1776167937-3458) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 254727 INFO  (qtp1776167937-3458) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 254728 INFO  (qtp1776167937-3458) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 254728 INFO  (qtp1776167937-3458) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 254729 INFO  (qtp1776167937-3458) [    ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=9.490234375, floorSegmentMB=2.1435546875, forceMergeDeletesPctAllowed=10.317658707951537, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4594798699628613
   [junit4]   2> 254729 INFO  (qtp1776167937-3458) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2ca9eba[control_collection_shard1_replica_n1] main]
   [junit4]   2> 254730 INFO  (qtp1776167937-3458) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 254730 INFO  (qtp1776167937-3458) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 254730 INFO  (qtp1776167937-3458) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 254731 INFO  (searcherExecutor-1342-thread-1) [    ] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@2ca9eba[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 254732 INFO  (qtp1776167937-3458) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576696394000891904
   [junit4]   2> 254734 INFO  (qtp1776167937-3458) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 254734 INFO  (qtp1776167937-3458) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 254734 INFO  (qtp1776167937-3458) [    ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41659/qzx/control_collection_shard1_replica_n1/
   [junit4]   2> 254734 INFO  (qtp1776167937-3458) [    ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 254734 INFO  (qtp1776167937-3458) [    ] o.a.s.c.SyncStrategy http://127.0.0.1:41659/qzx/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 254734 INFO  (qtp1776167937-3458) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 254735 INFO  (qtp1776167937-3458) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41659/qzx/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 254837 INFO  (zkCallback-813-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 254886 INFO  (qtp1776167937-3458) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 254894 INFO  (qtp1776167937-3458) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1280
   [junit4]   2> 254901 INFO  (qtp1776167937-3456) [    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 255004 INFO  (zkCallback-813-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 255514 INFO  (OverseerCollectionConfigSetProcessor-98543524527865860-127.0.0.1:41659_qzx-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 255901 INFO  (qtp1776167937-3456) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:41659_qzx&wt=javabin&version=2} status=0 QTime=2391
   [junit4]   2> 255921 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 255922 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45549/solr ready
   [junit4]   2> 255923 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 255923 INFO  (SocketProxy-Acceptor-41659) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=41682,localport=41659], receiveBufferSize:531000
   [junit4]   2> 255927 INFO  (SocketProxy-Acceptor-41659) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=32937,localport=35480], receiveBufferSize=530904
   [junit4]   2> 255932 INFO  (qtp1776167937-3453) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 255933 INFO  (OverseerThreadFactory-1339-thread-2) [    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 255934 WARN  (OverseerThreadFactory-1339-thread-2) [    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 256142 INFO  (qtp1776167937-3453) [    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 256142 INFO  (qtp1776167937-3453) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=209
   [junit4]   2> 256254 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-1-001 of type TLOG
   [junit4]   2> 256255 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 256257 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@41f2ec44{/qzx,null,AVAILABLE}
   [junit4]   2> 256257 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@4904d31d{HTTP/1.1,[http/1.1]}{127.0.0.1:38061}
   [junit4]   2> 256257 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.Server Started @257975ms
   [junit4]   2> 256257 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/qzx, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/tempDir-001/jetty1, hostPort=33743, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-1-001/cores, replicaType=TLOG}
   [junit4]   2> 256258 ERROR (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 256258 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 256258 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 256258 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 256258 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-25T09:54:17.255415Z
   [junit4]   2> 256261 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 256261 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-1-001/solr.xml
   [junit4]   2> 256264 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 256268 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45549/solr
   [junit4]   2> 256277 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 256278 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 256280 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33743_qzx
   [junit4]   2> 256280 INFO  (zkCallback-820-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 256287 INFO  (zkCallback-813-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 256293 INFO  (zkCallback-825-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 256362 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 256380 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 256381 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 256382 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-1-001/cores
   [junit4]   2> 256406 INFO  (qtp1776167937-3457) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:33743_qzx&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 256411 INFO  (OverseerCollectionConfigSetProcessor-98543524527865860-127.0.0.1:41659_qzx-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 256427 INFO  (OverseerThreadFactory-1339-thread-3) [    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:33743_qzx for creating new replica
   [junit4]   2> 256428 INFO  (SocketProxy-Acceptor-33743) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=43496,localport=33743], receiveBufferSize:531000
   [junit4]   2> 256443 INFO  (SocketProxy-Acceptor-33743) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38061,localport=54864], receiveBufferSize=530904
   [junit4]   2> 256445 INFO  (qtp1643711443-3505) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 256446 INFO  (qtp1643711443-3505) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 257463 INFO  (qtp1643711443-3505) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 257476 INFO  (qtp1643711443-3505) [    ] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
   [junit4]   2> 258035 INFO  (qtp1643711443-3505) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 258049 INFO  (qtp1643711443-3505) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
   [junit4]   2> 258050 INFO  (qtp1643711443-3505) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 258050 INFO  (qtp1643711443-3505) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 258050 INFO  (qtp1643711443-3505) [    ] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
   [junit4]   2> 258054 INFO  (qtp1643711443-3505) [    ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1144995934, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 258057 WARN  (qtp1643711443-3505) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 258104 INFO  (qtp1643711443-3505) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 258104 INFO  (qtp1643711443-3505) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 258105 INFO  (qtp1643711443-3505) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 258105 INFO  (qtp1643711443-3505) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 258106 INFO  (qtp1643711443-3505) [    ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=9.490234375, floorSegmentMB=2.1435546875, forceMergeDeletesPctAllowed=10.317658707951537, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4594798699628613
   [junit4]   2> 258106 INFO  (qtp1643711443-3505) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@26de2124[collection1_shard2_replica_t41] main]
   [junit4]   2> 258107 INFO  (qtp1643711443-3505) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 258107 INFO  (qtp1643711443-3505) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 258108 INFO  (qtp1643711443-3505) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 258108 INFO  (qtp1643711443-3505) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576696397540884480
   [junit4]   2> 258112 INFO  (searcherExecutor-1353-thread-1) [    ] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@26de2124[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 258113 INFO  (qtp1643711443-3505) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 258113 INFO  (qtp1643711443-3505) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 258113 INFO  (qtp1643711443-3505) [    ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33743/qzx/collection1_shard2_replica_t41/
   [junit4]   2> 258113 INFO  (qtp1643711443-3505) [    ] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 258113 INFO  (qtp1643711443-3505) [    ] o.a.s.c.SyncStrategy http://127.0.0.1:33743/qzx/collection1_shard2_replica_t41/ has no replicas
   [junit4]   2> 258113 INFO  (qtp1643711443-3505) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 258114 INFO  (qtp1643711443-3505) [    ] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
   [junit4]   2> 258115 INFO  (qtp1643711443-3505) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33743/qzx/collection1_shard2_replica_t41/ shard2
   [junit4]   2> 258266 INFO  (qtp1643711443-3505) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 258267 INFO  (qtp1643711443-3505) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1821
   [junit4]   2> 258268 INFO  (qtp1776167937-3457) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:33743_qzx&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1862
   [junit4]   2> 258408 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-2-001 of type TLOG
   [junit4]   2> 258409 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 258413 INFO  (OverseerCollectionConfigSetProcessor-98543524527865860-127.0.0.1:41659_qzx-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 258440 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@59ab5d56{/qzx,null,AVAILABLE}
   [junit4]   2> 258440 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@34a0af4c{HTTP/1.1,[http/1.1]}{127.0.0.1:38003}
   [junit4]   2> 258441 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.e.j.s.Server Started @260158ms
   [junit4]   2> 258441 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/qzx, solrconfig=solrconfig.xml, solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/tempDir-001/jetty2, hostPort=33857, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-2-001/cores, replicaType=TLOG}
   [junit4]   2> 258441 ERROR (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 258442 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 258442 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 258442 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 258442 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-25T09:54:19.439119Z
   [junit4]   2> 258445 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 258445 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-2-001/solr.xml
   [junit4]   2> 258447 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 258451 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45549/solr
   [junit4]   2> 258477 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 258479 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 258480 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33857_qzx
   [junit4]   2> 258481 INFO  (zkCallback-813-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 258481 INFO  (zkCallback-825-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 258482 INFO  (zkCallback-820-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 258483 INFO  (zkCallback-831-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 258535 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 258546 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 258546 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 258548 INFO  (TEST-HttpPartitionTest.test-seed#[202F446799C7A621]) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-2-001/cores
   [junit4]   2> 258580 INFO  (qtp1776167937-3458) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:33857_qzx&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 258582 INFO  (OverseerThreadFactory-1339-thread-4) [    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:33857_qzx for creating new replica
   [junit4]   2> 258583 INFO  (SocketProxy-Acceptor-33857) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=35832,localport=33857], receiveBufferSize:531000
   [junit4]   2> 258603 INFO  (SocketProxy-Acceptor-33857) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=38003,localport=58218], receiveBufferSize=530904
   [junit4]   2> 258606 INFO  (qtp634359619-3537) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 258607 INFO  (qtp634359619-3537) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 259618 INFO  (qtp634359619-3537) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 259654 INFO  (qtp634359619-3537) [    ] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
   [junit4]   2> 259747 INFO  (qtp634359619-3537) [    ] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 259761 INFO  (qtp634359619-3537) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
   [junit4]   2> 259773 INFO  (qtp634359619-3537) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@49dd6b6b
   [junit4]   2> 259773 INFO  (qtp634359619-3537) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 259773 INFO  (qtp634359619-3537) [    ] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_202F446799C7A621-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
   [junit4]   2> 259777 INFO  (qtp634359619-3537) [    ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1144995934, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 259795 WARN  (qtp634359619-3537) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 259843 INFO  (qtp634359619-3537) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 259843 INFO  (qtp634359619-3537) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 259860 INFO  (qtp634359619-3537) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 259862 INFO  (qtp634359619-3537) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 259863 INFO  (qtp634359619-3537) [    ] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=50, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=9.490234375, floorSegmentMB=2.1435546875, forceMergeDeletesPctAllowed=10.317658707951537, segmentsPerTier=35.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.4594798699628613
   [junit4]   2> 259863 INFO  (qtp634359619-3537) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b179700[collection1_shard1_replica_t43] main]
   [junit4]   2> 259865 INFO  (qtp634359619-3537) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 259865 INFO  (qtp634359619-3537) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 259866 INFO  (qtp634359619-3537) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 259868 INFO  (searcherExecutor-1364-thread-1) [    ] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@2b179700[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 259868 INFO  (qtp634359619-3537) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576696399386378240
   [junit4]   2> 259894 INFO  (qtp634359619-3537) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 259894 INFO  (qtp634359619-3537) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 259894 INFO  (qtp634359619-3537) [    ] o.

[...truncated too long message...]

 [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J2-20170825_103939_5653120418022092423968.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J0-20170825_103939_5657142526499386257749.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 499 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20170825_104025_7254848595676869403069.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20170825_104025_7241493255290758767588.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20170825_104025_7241093644299583635821.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1131 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20170825_104043_10013713321011166026796.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20170825_104043_10015933793559480321762.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 596 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20170825_104049_56011374348145513431578.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20170825_104049_56016252913524872334140.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20170825_104049_5605774063523110753140.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 503 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20170825_104109_91312931600196163131742.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20170825_104109_91810458246469956877259.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20170825_104109_91312037109374134428611.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 507 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20170825_104121_4435677321817820173440.syserr
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20170825_104121_44313675201563638142920.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 595 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20170825_104127_1797716949535835847154.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20170825_104127_17912819413261706970159.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20170825_104127_17913374254024212776149.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 538 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20170825_104154_35011961365259774199368.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20170825_104154_35015294094101028096703.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 494 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20170825_104203_9699083734020515157680.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 28972 lines...]

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+181) - Build # 20370 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20370/
Java: 64bit/jdk-9-ea+181 -XX:+UseCompressedOops -XX:+UseParallelGC --illegal-access=deny

1 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Doc with id=1 not found in http://127.0.0.1:32801/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:32801/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([D3E01CFD9172A7F8:5BB423273F8ECA00]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 11543 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_D3E01CFD9172A7F8-001/init-core-data-001
   [junit4]   2> 665841 WARN  (SUITE-HttpPartitionTest-seed#[D3E01CFD9172A7F8]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
   [junit4]   2> 665847 ERROR (Thread-1853) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 666031 ERROR (TEST-HttpPartitionTest.test-seed#[D3E01CFD9172A7F8]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 667333 WARN  (qtp1111064693-74540) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 668519 WARN  (OverseerThreadFactory-3047-thread-2) [    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 668802 ERROR (TEST-HttpPartitionTest.test-seed#[D3E01CFD9172A7F8]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 668803 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e17c55c500007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 669992 WARN  (qtp362120906-74592) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 670269 ERROR (TEST-HttpPartitionTest.test-seed#[D3E01CFD9172A7F8]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 670282 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e17c55c50000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 671485 WARN  (qtp119444824-74626) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 671740 ERROR (TEST-HttpPartitionTest.test-seed#[D3E01CFD9172A7F8]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 672935 WARN  (qtp1068294949-74659) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 678204 WARN  (qtp119444824-74619) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 678213 WARN  (qtp1068294949-74660) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 680317 WARN  (zkCallback-68754-thread-1) [    ] o.a.s.c.LeaderElector 
   [junit4]   2> org.apache.solr.common.SolrException: SolrCore not found:c8n_crud_1x2_shard1_replica_t2 in [collection1_shard2_replica_t45]
   [junit4]   2> 	at org.apache.solr.cloud.ShardLeaderElectionContext.runLeaderProcess(ElectionContext.java:297)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector.access$200(LeaderElector.java:56)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderElector$ElectionWatcher.process(LeaderElector.java:348)
   [junit4]   2> 	at org.apache.solr.common.cloud.SolrZkClient$3.lambda$process$0(SolrZkClient.java:269)
   [junit4]   2> 	at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:514)
   [junit4]   2> 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 682674 WARN  (qtp362120906-74593) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 682675 WARN  (qtp119444824-74620) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 682748 WARN  (qtp1111064693-74539) [    ] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 685015 WARN  (TEST-HttpPartitionTest.test-seed#[D3E01CFD9172A7F8]) [    ] o.a.s.c.SocketProxy Closing 6 connections to: http://127.0.0.1:39293/, target: http://127.0.0.1:35371/
   [junit4]   2> 685060 ERROR (updateExecutor-68739-thread-1) [    ] o.a.s.u.ErrorReportingConcurrentUpdateSolrClient error
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 685061 WARN  (qtp362120906-74593) [    ] o.a.s.u.p.DistributedUpdateProcessor Error sending update to http://127.0.0.1:39293
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 685061 ERROR (qtp362120906-74593) [    ] o.a.s.u.p.DistributedUpdateProcessor Setting up to try to start recovery on replica http://127.0.0.1:39293/collMinRf_1x3_shard1_replica_t3/
   [junit4]   2> java.net.SocketException: Broken pipe (Write failed)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite0(Native Method)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:111)
   [junit4]   2> 	at java.base/java.net.SocketOutputStream.write(SocketOutputStream.java:155)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.streamWrite(SessionOutputBufferImpl.java:126)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flushBuffer(SessionOutputBufferImpl.java:138)
   [junit4]   2> 	at org.apache.http.impl.io.SessionOutputBufferImpl.flush(SessionOutputBufferImpl.java:146)
   [junit4]   2> 	at org.apache.http.impl.io.ChunkedOutputStream.close(ChunkedOutputStream.java:205)
   [junit4]   2> 	at org.apache.http.impl.DefaultBHttpClientConnection.sendRequestEntity(DefaultBHttpClientConnection.java:159)
   [junit4]   2> 	at org.apache.http.impl.conn.CPoolProxy.sendRequestEntity(CPoolProxy.java:162)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.doSendRequest(HttpRequestExecutor.java:237)
   [junit4]   2> 	at org.apache.http.protocol.HttpRequestExecutor.execute(HttpRequestExecutor.java:122)
   [junit4]   2> 	at org.apache.solr.util.stats.InstrumentedHttpRequestExecutor.execute(InstrumentedHttpRequestExecutor.java:118)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:271)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.sendUpdateStream(ConcurrentUpdateSolrClient.java:347)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.ConcurrentUpdateSolrClient$Runner.run(ConcurrentUpdateSolrClient.java:182)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 685063 WARN  (updateExecutor-68739-thread-1) [    ] o.a.s.c.LeaderInitiatedRecoveryThread Leader is publishing core=collMinRf_1x3_shard1_replica_t3 coreNodeName =core_node6 state=down on behalf of un-reachable replica http://127.0.0.1:39293/collMinRf_1x3_shard1_replica_t3/
   [junit4]   2> 685084 ERROR (updateExecutor-68739-thread-1) [    ] o.a.s.c.LeaderInitiatedRecoveryThread http://127.0.0.1:39293: Could not tell a replica to recover:org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://127.0.0.1:39293
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:634)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
   [junit4]   2> 	at org.apache.solr.client.solrj.SolrClient.request(SolrClient.java:1219)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderInitiatedRecoveryThread.sendRecoveryCommandWithRetry(LeaderInitiatedRecoveryThread.java:209)
   [junit4]   2> 	at org.apache.solr.cloud.LeaderInitiatedRecoveryThread.run(LeaderInitiatedRecoveryThread.java:95)
   [junit4]   2> 	at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
   [junit4]   2> 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]   2> 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> Caused by: org.apache.http.conn.HttpHostConnectException: Connect to 127.0.0.1:39293 [/127.0.0.1] failed: Connection refused (Connection refused)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:151)
   [junit4]   2> 	at org.apache.http.impl.conn.PoolingHttpClientConnectionManager.connect(PoolingHttpClientConnectionManager.java:353)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.establishRoute(MainClientExec.java:380)
   [junit4]   2> 	at org.apache.http.impl.execchain.MainClientExec.execute(MainClientExec.java:236)
   [junit4]   2> 	at org.apache.http.impl.execchain.ProtocolExec.execute(ProtocolExec.java:184)
   [junit4]   2> 	at org.apache.http.impl.execchain.RetryExec.execute(RetryExec.java:88)
   [junit4]   2> 	at org.apache.http.impl.execchain.RedirectExec.execute(RedirectExec.java:110)
   [junit4]   2> 	at org.apache.http.impl.client.InternalHttpClient.doExecute(InternalHttpClient.java:184)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:82)
   [junit4]   2> 	at org.apache.http.impl.client.CloseableHttpClient.execute(CloseableHttpClient.java:55)
   [junit4]   2> 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:526)
   [junit4]   2> 	... 10 more
   [junit4]   2> Caused by: java.net.ConnectException: Connection refused (Connection refused)
   [junit4]   2> 	at java.base/java.net.PlainSocketImpl.socketConnect(Native Method)
   [junit4]   2> 	at java.base/java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:400)
   [junit4]   2> 	at java.base/java.net.AbstractPlainSocketImpl.connectToAddress(AbstractPlainSocketImpl.java:243)
   [junit4]   2> 	at java.base/java.net.AbstractPlainSocketImpl.connect(AbstractPlainSocketImpl.java:225)
   [junit4]   2> 	at java.base/java.net.SocksSocketImpl.connect(SocksSocketImpl.java:402)
   [junit4]   2> 	at java.base/java.net.Socket.connect(Socket.java:591)
   [junit4]   2> 	at org.apache.http.conn.socket.PlainConnectionSocketFactory.connectSocket(PlainConnectionSocketFactory.java:74)
   [junit4]   2> 	at org.apache.http.impl.conn.DefaultHttpClientConnectionOperator.connect(DefaultHttpClientConnectionOperator.java:134)
   [junit4]   2> 	... 20 more
   [junit4]   2> 
   [junit4]   2> 690087 WARN  (updateExecutor-68739-thread-1) [    ] o.a.s.c.LeaderInitiatedRecoveryThread Asking core=collMinRf_1x3_shard1_replica_t3 coreNodeName=core_node6 on http://127.0.0.1:39293 to recover; unsuccessful after 2 of 120 attempts so far ...
   [junit4]   2> 690855 WARN  (recoveryExecutor-68746-thread-1) [    ] o.a.s.h.IndexFetcher File segments_2 did not match. expected checksum is 1923724575 and actual is checksum 2786456066. expected length is 203 and actual length is 120
   [junit4]   2> 692995 WARN  (zkCallback-68730-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 694553 WARN  (zkCallback-68742-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 695556 WARN  (zkCallback-68748-thread-1) [    ] o.a.s.c.SyncStrategy Closed, skipping sync up.
   [junit4]   2> 696078 WARN  (zkCallback-68748-thread-5) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 697608 WARN  (zkCallback-68754-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 697612 ERROR (TEST-HttpPartitionTest.test-seed#[D3E01CFD9172A7F8]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 704133 WARN  (Thread-1853) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 	3	/solr/collections/collection1/state.json
   [junit4]   2> 	3	/solr/collections/collMinRf_1x3/state.json
   [junit4]   2> 	2	/solr/collections/c8n_crud_1x2/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	4	/solr/overseer/queue
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 704133 WARN  (TEST-HttpPartitionTest.test-seed#[D3E01CFD9172A7F8]) [    ] o.a.s.c.SocketProxy Closing 2 connections to: http://127.0.0.1:39293/, target: http://127.0.0.1:35371/
   [junit4]   2> 704133 WARN  (TEST-HttpPartitionTest.test-seed#[D3E01CFD9172A7F8]) [    ] o.a.s.c.SocketProxy Closing 6 connections to: http://127.0.0.1:32801/, target: http://127.0.0.1:37897/
   [junit4]   2> 704133 WARN  (TEST-HttpPartitionTest.test-seed#[D3E01CFD9172A7F8]) [    ] o.a.s.c.SocketProxy Closing 3 connections to: http://127.0.0.1:42883/, target: http://127.0.0.1:44967/
   [junit4]   2> 704133 WARN  (TEST-HttpPartitionTest.test-seed#[D3E01CFD9172A7F8]) [    ] o.a.s.c.SocketProxy Closing 15 connections to: http://127.0.0.1:34357/, target: http://127.0.0.1:42035/
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpPartitionTest -Dtests.method=test -Dtests.seed=D3E01CFD9172A7F8 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=so-ET -Dtests.timezone=NST -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 38.3s J0 | HttpPartitionTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:32801/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D3E01CFD9172A7F8:5BB423273F8ECA00]:0)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.HttpPartitionTest_D3E01CFD9172A7F8-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {multiDefault=PostingsFormat(name=LuceneVarGapFixedInterval), a_t=PostingsFormat(name=Direct), id=PostingsFormat(name=MockRandom), text=PostingsFormat(name=Memory)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Memory), range_facet_i_dv=DocValuesFormat(name=Memory), intDvoDefault=DocValuesFormat(name=Lucene70), timestamp=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1106, maxMBSortInHeap=5.079911167016023, sim=RandomSimilarity(queryNorm=false): {}, locale=so-ET, timezone=NST
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 9 (64-bit)/cpus=8,threads=1,free=136455768,total=527958016
   [junit4]   2> NOTE: All tests run in this JVM: [PeerSyncTest, PreAnalyzedFieldManagedSchemaCloudTest, TestSSLRandomization, SolrPluginUtilsTest, CdcrUpdateLogTest, TestManagedSynonymGraphFilterFactory, TestMinMaxOnMultiValuedField, TestBadConfig, TestLMDirichletSimilarityFactory, TestDocSet, OverseerCollectionConfigSetProcessorTest, UUIDFieldTest, DistributedFacetPivotLargeTest, TestManagedResourceStorage, TestCustomSort, ReplicationFactorTest, RAMDirectoryFactoryTest, TestPayloadCheckQParserPlugin, LeaderFailureAfterFreshStartTest, DistributedQueryComponentOptimizationTest, TestPerFieldSimilarityWithDefaultOverride, SolrJmxReporterTest, TestComponentsName, MigrateRouteKeyTest, SpellCheckCollatorTest, TestDistribIDF, OpenExchangeRatesOrgProviderTest, HdfsDirectoryTest, HighlighterMaxOffsetTest, DocValuesMissingTest, TestGraphTermsQParserPlugin, DocumentAnalysisRequestHandlerTest, CursorMarkTest, AliasIntegrationTest, OutputWriterTest, DistributedDebugComponentTest, TestFunctionQuery, TestImplicitCoreProperties, TestConfigSetsAPIExclusivity, BlockCacheTest, SharedFSAutoReplicaFailoverTest, TestBulkSchemaConcurrent, TestCollectionAPIs, TestLegacyNumericRangeQueryBuilder, UpdateParamsTest, TestManagedSchemaAPI, HdfsTlogReplayBufferedWhileIndexingTest, TestSolrCloudWithSecureImpersonation, RecoveryAfterSoftCommitTest, TestLegacyFieldCache, QueryElevationComponentTest, TestSizeLimitedDistributedMap, TestSolrQueryParser, DirectoryFactoryTest, TestCollectionAPI, TestJoin, TestCSVLoader, TestRealTimeGet, TestTolerantUpdateProcessorRandomCloud, TestBinaryResponseWriter, TestRandomCollapseQParserPlugin, XmlUpdateRequestHandlerTest, UpdateLogTest, TestReplicationHandler, MetricsHandlerTest, TestSimpleTextCodec, SolrShardReporterTest, TestLuceneMatchVersion, FullHLLTest, ZkStateWriterTest, TestJettySolrRunner, QueryResultKeyTest, TestBinaryField, CollectionsAPIAsyncDistributedZkTest, CustomCollectionTest, DistributedFacetPivotSmallTest, SolrCLIZkUtilsTest, JvmMetricsTest, TestUninvertingReader, TestMacros, TestPHPSerializedResponseWriter, ClassificationUpdateProcessorIntegrationTest, AtomicUpdateProcessorFactoryTest, DistanceUnitsTest, TestGeoJSONResponseWriter, DefaultValueUpdateProcessorTest, TestSolrCoreParser, TestCrossCoreJoin, TestLegacyField, HttpPartitionTest]
   [junit4] Completed [238/732 (1!)] on J0 in 38.31s, 1 test, 1 failure <<< FAILURES!

[...truncated 38126 lines...]

[JENKINS-EA] Lucene-Solr-master-Linux (32bit/jdk-9-ea+181) - Build # 20369 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20369/
Java: 32bit/jdk-9-ea+181 -server -XX:+UseConcMarkSweepGC --illegal-access=deny

2 tests failed.
FAILED:  org.apache.solr.cloud.TestPullReplica.testKillLeader

Error Message:
Replica state not updated in cluster state null Live Nodes: [127.0.0.1:34435_solr, 127.0.0.1:35267_solr] Last available state: DocCollection(pull_replica_test_kill_leader//collections/pull_replica_test_kill_leader/state.json/5)={   "pullReplicas":"1",   "replicationFactor":"1",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"pull_replica_test_kill_leader_shard1_replica_n1",           "base_url":"http://127.0.0.1:35267/solr",           "node_name":"127.0.0.1:35267_solr",           "state":"down",           "type":"NRT",           "leader":"true"},         "core_node4":{           "core":"pull_replica_test_kill_leader_shard1_replica_p2",           "base_url":"http://127.0.0.1:34435/solr",           "node_name":"127.0.0.1:34435_solr",           "state":"active",           "type":"PULL"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"100",   "autoAddReplicas":"false",   "nrtReplicas":"1",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Replica state not updated in cluster state
null
Live Nodes: [127.0.0.1:34435_solr, 127.0.0.1:35267_solr]
Last available state: DocCollection(pull_replica_test_kill_leader//collections/pull_replica_test_kill_leader/state.json/5)={
  "pullReplicas":"1",
  "replicationFactor":"1",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"pull_replica_test_kill_leader_shard1_replica_n1",
          "base_url":"http://127.0.0.1:35267/solr",
          "node_name":"127.0.0.1:35267_solr",
          "state":"down",
          "type":"NRT",
          "leader":"true"},
        "core_node4":{
          "core":"pull_replica_test_kill_leader_shard1_replica_p2",
          "base_url":"http://127.0.0.1:34435/solr",
          "node_name":"127.0.0.1:34435_solr",
          "state":"active",
          "type":"PULL"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"100",
  "autoAddReplicas":"false",
  "nrtReplicas":"1",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([79191CE29380BDE4:300FE856F13B29B2]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
	at org.apache.solr.cloud.TestPullReplica.doTestNoLeader(TestPullReplica.java:401)
	at org.apache.solr.cloud.TestPullReplica.testKillLeader(TestPullReplica.java:290)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
No 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: No 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([79191CE29380BDE4:26FD31D5F88C2EA1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:85)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1695 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J2-20170824_233122_61210842458152960665530.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J1-20170824_233122_61216790587773852153825.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J0-20170824_233122_612834426925198270172.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 247 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J1-20170824_233918_87013024709144582931090.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 41 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J2-20170824_233918_8707360170372677379184.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J0-20170824_233918_8702528514592261488866.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1033 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20170824_234048_98716046263607527091068.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20170824_234048_9872804592673934069719.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20170824_234048_98713853973587381152462.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 218 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20170824_234306_95711725491476274009715.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20170824_234306_9578656774046006644099.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20170824_234306_9572441417822341205173.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 234 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20170824_234318_2558347192470084139782.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20170824_234318_2558380883253190768333.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20170824_234318_2559754382427965758532.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 146 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20170824_234344_1205439949484270028694.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20170824_234344_12018302000356747363889.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20170824_234344_1209937305043717369134.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 155 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20170824_234347_81312237277399595535689.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20170824_234347_8137390192832861779576.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20170824_234347_81310864738553974612620.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 145 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20170824_234357_71314631764628104349137.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20170824_234357_7138604196334483891184.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 149 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20170824_234407_6553825714406608272080.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20170824_234407_6555661502235901071878.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20170824_234407_6554743164819110256155.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 161 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20170824_234410_7872758987504053284180.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 140 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20170824_234418_91515021399964346119962.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20170824_234418_91515566517107444176414.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 25 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20170824_234418_9153145887283820995175.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1209 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J1-20170824_234429_8459526419902590892623.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J2-20170824_234429_84516996911406354238466.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J0-20170824_234429_8459424011808870372406.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 223 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J1-20170824_234439_41618088625084650083012.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J0-20170824_234439_4162173640589329465225.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J2-20170824_234439_416608150500335462940.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 246 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20170824_234452_70613482966812875946073.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J1-20170824_234452_70613130060516244202334.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J0-20170824_234452_70611277211778128556113.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 223 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J2-20170824_234741_7927830942217021770993.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J0-20170824_234741_79215685584372523086542.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J1-20170824_234741_7921770089000075131811.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 162 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J1-20170824_234745_007475680018626177825.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J2-20170824_234745_00713365578594126080301.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J0-20170824_234745_0043772331954176502460.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 207 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J1-20170824_234751_2528964354875664874730.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J2-20170824_234751_25216379527802039305861.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J0-20170824_234751_25212409819629647147861.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 171 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J2-20170824_234822_44916180378798290730015.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J0-20170824_234822_4494110793515808769355.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J1-20170824_234822_4492505534255238650009.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 232 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J2-20170824_234833_3443023970475691448328.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J1-20170824_234833_34114746740750668651649.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J0-20170824_234833_3419348497332124761315.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 152 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J2-20170824_234847_9803158915217076924062.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J0-20170824_234847_9746933820480335825594.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J1-20170824_234847_9786368240896420607967.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 141 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J0-20170824_234914_7161265910494062169624.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J1-20170824_234914_71610913879232759586497.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 167 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J1-20170824_234926_4872093849162108986206.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J2-20170824_234926_48716310171112018716877.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J0-20170824_234926_4871792765047536338625.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 307 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J1-20170824_234945_7152264451132784048851.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J0-20170824_234945_71510173983408436954973.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J2-20170824_234945_7157493927193675426631.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 216 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J0-20170824_234953_1759441613305320065094.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J2-20170824_234953_17516611425366410905989.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J1-20170824_234953_17517090629242511127198.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 199 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J1-20170824_234959_61813623143728920342562.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J2-20170824_234959_6183796295871592689815.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J0-20170824_234959_6189466816382753670904.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 197 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J0-20170824_235011_49911663216975042708806.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J2-20170824_235011_4998844034447458283890.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 10 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J1-20170824_235011_4997556878925753292551.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 207 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20170824_235102_25214241311358427397628.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20170824_235102_25213270159673391770841.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20170824_235102_2528878181025969926734.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 140 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial/test/temp/junit4-J0-20170824_235113_0997390582872836710398.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 157 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20170824_235115_23644354218764032620.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20170824_235115_23618395991147967450340.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 11 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20170824_235115_2369962826125599645065.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 233 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J2-20170824_235209_7829318126907571641559.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J0-20170824_235209_7816910473402821308457.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 12 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J1-20170824_235209_7816736124155325983211.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 1531 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_79191CE29380BDE4-001/init-core-data-001
   [junit4]   2> 194430 WARN  (SUITE-SolrSlf4jReporterTest-seed#[79191CE29380BDE4]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=79191CE29380BDE4 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=no -Dtests.timezone=Asia/Ulan_Bator -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 6.34s J1 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: No 'solr.node' logs in: {numFound=0,start=0,docs=[]}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([79191CE29380BDE4:26FD31D5F88C2EA1]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:85)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_79191CE29380BDE4-001
   [junit4]   2> NOTE: test params are: codec=HighCompressionCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=9, maxDocsPerChunk=450, blockSize=42), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=HIGH_COMPRESSION, chunkSize=9, blockSize=42)), sim=RandomSimilarity(queryNorm=true): {}, locale=no, timezone=Asia/Ulan_Bator
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 9 (32-bit)/cpus=8,threads=1,free=32914472,total=131276800
   [junit4]   2> NOTE: All tests run in this JVM: [StatsReloadRaceTest, DirectSolrConnectionTest, TestBM25SimilarityFactory, TestAuthorizationFramework, DistributedQueueTest, SolrMetricReporterTest, EnumFieldTest, TestLegacyFieldReuse, HdfsLockFactoryTest, TestReloadAndDeleteDocs, TestQueryTypes, MoreLikeThisHandlerTest, TestEmbeddedSolrServerConstructors, TestSolrCoreSnapshots, DistributedFacetPivotLongTailTest, CollectionStateFormat2Test, TestNumericTokenStream, DistributedExpandComponentTest, SolrCmdDistributorTest, TestSolrCLIRunExample, ClusterStateUpdateTest, TestGraphMLResponseWriter, SolrSlf4jReporterTest]
   [junit4] Completed [60/732 (1!)] on J1 in 6.37s, 1 test, 1 failure <<< FAILURES!

[...truncated 773 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestPullReplica
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_79191CE29380BDE4-001/init-core-data-001
   [junit4]   2> 1194878 WARN  (SUITE-TestPullReplica-seed#[79191CE29380BDE4]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=17 numCloses=17
   [junit4]   2> 1194896 ERROR (Thread-1899) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1195084 ERROR (jetty-launcher-1346-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1195158 ERROR (jetty-launcher-1346-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1195674 WARN  (OverseerThreadFactory-3735-thread-1) [    ] o.a.s.c.CreateCollectionCmd Specified number of replicas of 4 on collection pull_replica_test_create_delete is higher than the number of Solr instances currently live or live and part of your createNodeSet(2). It's unusual to run two replica of the same slice on the same Solr-instance.
   [junit4]   1> / (11)
   [junit4]   1>  /configs (2)
   [junit4]   1>   /configs/_default (7)
   [junit4]   1>    /configs/_default/protwords.txt (0)
   [junit4]   1>    DATA: ...supressed...
   [junit4]   1>    /configs/_default/managed-schema (0)
   [junit4]   1>    DATA:
   [junit4]   1>        <?xml version="1.0" encoding="UTF-8" ?>
   [junit4]   1>        <!--
   [junit4]   1>         Licensed to the Apache Software Foundation (ASF) under one or more
   [junit4]   1>         contributor license agreements.  See the NOTICE file distributed with
   [junit4]   1>         this work for additional information regarding copyright ownership.
   [junit4]   1>         The ASF licenses this file to You under the Apache License, Version 2.0
   [junit4]   1>         (the "License"); you may not use this file except in compliance with
   [junit4]   1>         the License.  You may obtain a copy of the License at
   [junit4]   1>        
   [junit4]   1>             http://www.apache.org/licenses/LICENSE-2.0
   [junit4]   1>        
   [junit4]   1>         Unless required by applicable law or agreed to in writing, software
   [junit4]   1>         distributed under the License is distributed on an "AS IS" BASIS,
   [junit4]   1>         WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
   [junit4]   1>         See the License for the specific language governing permissions and
   [junit4]   1>         limitations under the License.
   [junit4]   1>        -->
   [junit4]   1>        
   [junit4]   1>        <!--
   [junit4]   1>        
   [junit4]   1>         This example schema is the recommended starting point for users.
   [junit4]   1>         It should be kept correct and concise, usable out-of-the-box.
   [junit4]   1>        
   [junit4]   1>        
   [junit4]   1>         For more information, on how to customize this file, please see
   [junit4]   1>         http://lucene.apache.org/solr/guide/documents-fields-and-schema-design.html
   [junit4]   1>        
   [junit4]   1>         PERFORMANCE NOTE: this schema includes many optional features and should not
   [junit4]   1>         be used for benchmarking.  To improve performance one could
   [junit4]   1>          - set stored="false" for all fields possible (esp large fields) when you
   [junit4]   1>            only need to search on the field but don't need to return the original
   [junit4]   1>            value.
   [junit4]   1>          - set indexed="false" if you don't need to search on the field, but only
   [junit4]   1>            return the field as a result of searching on other indexed fields.
   [junit4]   1>          - remove all unneeded copyField statements
   [junit4]   1>          - for best index size and searching performance, set "index" to false
   [junit4]   1>            for all general text fields, use copyField to copy them to the
   [junit4]   1>            catchall "text" field, and use that for searching.
   [junit4]   1>        -->
   [junit4]   1>        
   [junit4]   1>        <schema name="default-config" version="1.6">
   [junit4]   1>            <!-- attribute "name" is the name of this schema and is only used for display purposes.
   [junit4]   1>               version="x.y" is Solr's version number for the schema syntax and 
   [junit4]   1>               semantics.  It should not normally be changed by applications.
   [junit4]   1>        
   [junit4]   1>               1.0: multiValued attribute did not exist, all fields are multiValued 
   [junit4]   1>                    by nature
   [junit4]   1>               1.1: multiValued attribute introduced, false by default 
   [junit4]   1>               1.2: omitTermFreqAndPositions attribute introduced, true by default 
   [junit4]   1>                    except for text fields.
   [junit4]   1>               1.3: removed optional field compress feature
   [junit4]   1>               1.4: autoGeneratePhraseQueries attribute introduced to drive QueryParser
   [junit4]   1>                    behavior when a single string produces multiple tokens.  Defaults 
   [junit4]   1>                    to off for version >= 1.4
   [junit4]   1>               1.5: omitNorms defaults to true for primitive field types 
   [junit4]   1>                    (int, float, boolean, string...)
   [junit4]   1>               1.6: useDocValuesAsStored defaults to true.
   [junit4]   1>            -->
   [junit4]   1>        
   [junit4]   1>            <!-- Valid attributes for fields:
   [junit4]   1>             name: mandatory - the name for the field
   [junit4]   1>             type: mandatory - the name of a field type from the 
   [junit4]   1>               fieldTypes section
   [junit4]   1>             indexed: true if this field should be indexed (searchable or sortable)
   [junit4]   1>             stored: true if this field should be retrievable
   [junit4]   1>             docValues: true if this field should have doc values. Doc Values is
   [junit4]   1>               recommended (required, if you are using *Point fields) for faceting,
   [junit4]   1>               grouping, sorting and function queries. Doc Values will make the index
   [junit4]   1>               faster to load, more NRT-friendly and more memory-efficient. 
   [junit4]   1>               They are currently only supported by StrField, UUIDField, all 
   [junit4]   1>               *PointFields, and depending on the field type, they might require
   [junit4]   1>               the field to be single-valued, be required or have a default value
   [junit4]   1>               (check the documentation of the field type you're interested in for
   [junit4]   1>               more information)
   [junit4]   1>             multiValued: true if this field may contain multiple values per document
   [junit4]   1>             omitNorms: (expert) set to true to omit the norms associated with
   [junit4]   1>               this field (this disables length normalization and index-time
   [junit4]   1>               boosting for the field, and saves some memory).  Only full-text
   [junit4]   1>               fields or fields that need an index-time boost need norms.
   [junit4]   1>               Norms are omitted for primitive (non-analyzed) types by default.
   [junit4]   1>             termVectors: [false] set to true to store the term vector for a
   [junit4]   1>               given field.
   [junit4]   1>               When using MoreLikeThis, fields used for similarity should be
   [junit4]   1>               stored for best performance.
   [junit4]   1>             termPositions: Store position information with the term vector.  
   [junit4]   1>               This will increase storage costs.
   [junit4]   1>             termOffsets: Store offset information with the term vector. This 
   [junit4]   1>               will increase storage costs.
   [junit4]   1>             required: The field is required.  It will throw an error if the
   [junit4]   1>               value does not exist
   [junit4]   1>             default: a value that should be used if no value is specified
   [junit4]   1>               when adding a document.
   [junit4]   1>            -->
   [junit4]   1>        
   [junit4]   1>            <!-- field names should consist of alphanumeric or underscore characters only and
   [junit4]   1>              not start with a digit.  This is not currently strictly enforced,
   [junit4]   1>              but other field names will not have first class support from all components
   [junit4]   1>              and back compatibility is not guaranteed.  Names with both leading and
   [junit4]   1>              trailing underscores (e.g. _version_) are reserved.
   [junit4]   1>            -->
   [junit4]   1>        
   [junit4]   1>            <!-- In this _default configset, only four fields are pre-declared:
   [junit4]   1>                 id, _version_, and _text_ and _root_. All other fields will be type guessed and added via the
   [junit4]   1>                 "add-unknown-fields-to-the-schema" update request processor chain declared in solrconfig.xml.
   [junit4]   1>                 
   [junit4]   1>                 Note that many dynamic fields are also defined - you can use them to specify a 
   [junit4]   1>                 field's type via field naming conventions - see below.
   [junit4]   1>          
   [junit4]   1>                 WARNING: The _text_ catch-all field will significantly increase your index size.
   [junit4]   1>                 If you don't need it, consider removing it and the corresponding copyField directive.
   [junit4]   1>            -->
   [junit4]   1>        
   [junit4]   1>            <field name="id" type="string" indexed="true" stored="true" required="true" multiValued="false" />
   [junit4]   1>            <!-- docValues are enabled by default for long type so we don't need to index the version field  -->
   [junit4]   1>            <field name="_version_" type="plong" indexed="false" stored="false"/>
   [junit4]   1>            <field name="_root_" type="string" indexed="true" stored="false" docValues="false" />
   [junit4]   1>            <field name="_text_" type="text_general" indexed="true" stored="false" multiValued="true"/>
   [junit4]   1>        
   [junit4]   1>            <!-- This can be enabled, in case the client does not know what fields may be searched. It isn't enabled by default
   [junit4]   1>                 because it's very expensive to index everything twice. -->
   [junit4]   1>            <!-- <copyField source="*" dest="_text_"/> -->
   [junit4]   1>        
   [junit4]   1>            <!-- Dynamic field definitions allow using convention over configuration
   [junit4]   1>               for fields via the specification of patterns to match field names.
   [junit4]   1>               EXAMPLE:  name="*_i" will match any field ending in _i (like myid_i, z_i)
   [junit4]   1>               RESTRICTION: the glob-like pattern in the name attribute must have a "*" only at the start or the end.  -->
   [junit4]   1>           
   [junit4]   1>            <dynamicField name="*_i"  type="pint"    indexed="true"  stored="true"/>
   [junit4]   1>            <dynamicField name="*_is" type="pints"    indexed="true"  stored="true"/>
   [junit4]   1>            <dynamicField name="*_s"  type="string"  indexed="true"  stored="true" />
   [junit4]   1>            <dynamicField name="*_ss" type="strings"  indexed="true"  stored="true"/>
   [junit4]   1>            <dynamicField name="*_l"  type="plong"   indexed="true"  stored="true"/>
   [junit4]   1>            <dynamicField name="*_ls" type="plongs"   indexed="true"  stored="true"/>
   [junit4]   1>            <dynamicField name="*_txt" type="text_general" indexed="true" stored="true"/>
   [junit4]   1>            <dynamicField name="*_b"  type="boolean" indexed="true" stored="true"/>
   [junit4]   1>            <dynamicField name="*_bs" type="booleans" indexed="true" stored="true"/>
   [junit4]   1>            <dynamicField name="*_f"  type="pfloat"  indexed="true"  stored="true"/>
   [junit4]   1>            <dynamicField name="*_fs" type="pfloats"  indexed="true"  stored="true"/>
   [junit4]   1>            <dynamicField name="*_d"  type="pdouble" indexed="true"  stored="true"/>
   [junit4]   1>            <dynamicField name="*_ds" type="pdoubles" indexed="true"  stored="true"/>
   [junit4]   1>        
   [junit4]   1>            <!-- Type used for data-driven schema, to add a string copy for each text field -->
   [junit4]   1>            <dynamicField name="*_str" type="strings" stored="false" docValues="true" indexed="false" />
   [junit4]   1>        
   [junit4]   1>            <dynamicField name="*_dt"  type="pdate"    indexed="true"  stored="true"/>
   [junit4]   1>            <dynamicField name="*_dts" type="pdate"    indexed="true"  stored="true" multiValued="true"/>
   [junit4]   1>            <dynamicField name="*_p"  type="location" indexed="true" stored="true"/>
   [junit4]   1>            <dynamicField name="*_srpt"  type="location_rpt" indexed="true" stored="true"/>
   [junit4]   1>            
   [junit4]   1>            <!-- payloaded dynamic fields -->
   [junit4]   1>            <dynamicField name="*_dpf" type="delimited_payloads_float" indexed="true"  stored="true"/>
   [junit4]   1>            <dynamicField name="*_dpi" type="delimited_payloads_int" indexed="true"  stored="true"/>
   [junit4]   1>            <dynamicField name="*_dps" type="delimited_payloads_string" indexed="true"  stored="true"/>
   [junit4]   1>        
   [junit4]   1>            <dynamicField name="attr_*" type="text_general" indexed="true" stored="true" multiValued="true"/>
   [junit4]   1>        
   [junit4]   1>            <!-- Field to use to determine and enforce document uniqueness.
   [junit4]   1>              Unless this field is marked with required="false", it will be a required field
   [junit4]   1>            -->
   [junit4]   1>            <uniqueKey>id</uniqueKey>
   [junit4]   1>        
   [junit4]   1>            <!-- copyField commands copy one field to another at the time a document
   [junit4]   1>               is added to the index.  It's used either to index the same field differently,
   [junit4]   1>               or to add multiple fields to the same field for easier/faster searching.
   [junit4]   1>        
   [junit4]   1>            <copyField source="sourceFieldName" dest="destinationFieldName"/>
   [junit4]   1>            -->
   [junit4]   1>        
   [junit4]   1>            <!-- field type definitions. The "name" attribute is
   [junit4]   1>               just a label to be used by field definitions.  The "class"
   [junit4]   1>               attribute and any other attributes determine the real
   [junit4]   1>               behavior of the fieldType.
   [junit4]   1>                 Class names starting with "solr" refer to java classes in a
   [junit4]   1>               standard package such as org.apache.solr.analysis
   [junit4]   1>            -->
   [junit4]   1>        
   [junit4]   1>            <!-- sortMissingLast and sortMissingFirst attributes are optional attributes are
   [junit4]   1>                 currently supported on types that are sorted internally as strings
   [junit4]   1>                 and on numeric types.
   [junit4]   1>               This includes "string", "boolean", "pint", "pfloat", "plong", "pdate", "pdouble".
   [junit4]   1>               - If sortMissingLast="true", then a sort on this field will cause documents
   [junit4]   1>                 without the field to come after documents with the field,
   [junit4]   1>                 regardless of the requested sort order (asc or desc).
   [junit4]   1>               - If sortMissingFirst="true", then a sort on this field will cause documents
   [junit4]   1>                 without the field to come before documents with the field,
   [junit4]   1>                 regardless of the requested sort order.
   [junit4]   1>               - If sortMissingLast="false" and sortMissingFirst="false" (the default),
   [junit4]   1>                 then default lucene sorting will be used which places docs without the
   [junit4]   1>                 field first in an ascending sort and last in a descending sort.
   [junit4]   1>            -->
   [junit4]   1>        
   [junit4]   1>            <!-- The StrField type is not analyzed, but indexed/stored verbatim.
   [junit4]   1>               It supports doc values but in that case the field needs to be
   [junit4]   1>               single-valued and either required or have a default value.
   [junit4]   1>              -->
   [junit4]   1>            <fieldType name="string" class="solr.StrField" sortMissingLast="true" docValues="true" />
   [junit4]   1>            <fieldType name="strings" class="solr.StrField" sortMissingLast="true" multiValued="true" docValues="true" />
   [junit4]   1>        
   [junit4]   1>            <!-- boolean type: "true" or "false" -->
   [junit4]   1>            <fieldType name="boolean" class="solr.BoolField" sortMissingLast="true"/>
   [junit4]   1>            <fieldType name="booleans" class="solr.BoolField" sortMissingLast="true" multiValued="true"/>
   [junit4]   1>        
   [junit4]   1>            <!--
   [junit4]   1>              Numeric field types that index values using KD-trees.
   [junit4]   1>              Point fields don't support FieldCache, so they must have docValues="true" if needed for sorting, faceting, functions, etc.
   [junit4]   1>            -->
   [junit4]   1>            <fieldType name="pint" class="solr.IntPointField" docValues="true"/>
   [junit4]   1>            <fieldType name="pfloat" class="solr.FloatPointField" docValues="true"/>
   [junit4]   1>            <fieldType name="plong" class="solr.LongPointField" docValues="true"/>
   [junit4]   1>            <fieldType name="pdouble" class="solr.DoublePointField" docValues="true"/>
   [junit4]   1>            
   [junit4]   1>            <fieldType name="pints" class="solr.IntPointField" docValues="true" multiValued="true"/>
   [junit4]   1>            <fieldType name="pfloats" class="solr.FloatPointField" docValues="true" multiValued="true"/>
   [junit4]   1>            <fieldType name="plongs" class="solr.LongPointField" docValues="true" multiValued="true"/>
   [junit4]   1>            <fieldType name="pdoubles" class="solr.DoublePointField" docValues="true" multiValued="true"/>
   [junit4]   1>        
   [junit4]   1>            <!-- The format for this date field is of the form 1995-12-31T23:59:59Z, and
   [junit4]   1>                 is a more restricted form of the canonical representation of dateTime
   [junit4]   1>                 http://www.w3.org/TR/xmlschema-2/#dateTime    
   [junit4]   1>                 The trailing "Z" designates UTC time and is mandatory.
   [junit4]   1>                 Optional fractional seconds are allowed: 1995-12-31T23:59:59.999Z
   [junit4]   1>                 All other components are mandatory.
   [junit4]   1>        
   [junit4]   1>                 Expressions can also be used to denote calculations that should be
   [junit4]   1>                 performed relative to "NOW" to determine the value, ie...
   [junit4]   1>        
   [junit4]   1>                       NOW/HOUR
   [junit4]   1>                          ... Round to the start of the current hour
   [junit4]   1>                       NOW-1DAY
   [junit4]   1>                          ... Exactly 1 day prior to now
   [junit4]   1>                       NOW/DAY+6MONTHS+3DAYS
   [junit4]   1>                          ... 6 months and 3 days in the future from the start of
   [junit4]   1>                              the current day
   [junit4]   1>                              
   [junit4]   1>              -->
   [junit4]   1>            <!-- KD-tree versions of date fields -->
   [junit4]   1>            <fieldType name="pdate" class="solr.DatePointField" docValues="true"/>
   [junit4]   1>            <fieldType name="pdates" class="solr.DatePointField" docValues="true" multiValued="true"/>
   [junit4]   1>            
   [junit4]   1>            <!--Binary data type. The data should be sent/retrieved in as Base64 encoded Strings -->
   [junit4]   1>            <fieldType name="binary" class="solr.BinaryField"/>
   [junit4]   1>        
   [junit4]   1>            <!-- solr.TextField allows the specification of custom text analyzers
   [junit4]   1>                 specified as a tokenizer and a list of token filters. Different
   [junit4]   1>                 analyzers may be specified for indexing and querying.
   [junit4]   1>        
   [junit4]   1>                 The optional positionIncrementGap puts space between multiple fields of
   [junit4]   1>                 this type on the same document, with the purpose of preventing false phrase
   [junit4]   1>                 matching across fields.
   [junit4]   1>        
   [junit4]   1>                 For more info on customizing your analyzer chain, please see
   [junit4]   1>                 http://lucene.apache.org/solr/guide/understanding-analyzers-tokenizers-and-filters.html#understanding-analyzers-tokenizers-and-filters
   [junit4]   1>             -->
   [junit4]   1>        
   [junit4]   1>            <!-- One can also specify an existing Analyzer class that has a
   [junit4]   1>                 default constructor via the class attribute on the analyzer element.
   [junit4]   1>                 Example:
   [junit4]   1>            <fieldType name="text_greek" class="solr.TextField">
   [junit4]   1>              <analyzer class="org.apache.lucene.analysis.el.GreekAnalyzer"/>
   [junit4]   1>            </fieldType>
   [junit4]   1>            -->
   [junit4]   1>        
   [junit4]   1>            <!-- A text field that only splits on whitespace for exact matching of words -->
   [junit4]   1>            <dynamicField name="*_ws" type="text_ws"  indexed="true"  stored="true"/>
   [junit4]   1>            <fieldType name="text_ws" class="solr.TextField" positionIncrementGap="100">
   [junit4]   1>              <analyzer>
   [junit4]   1>                <tokenizer class="solr.WhitespaceTokenizerFactory"/>
   [junit4]   1>              </analyzer>
   [junit4]   1>            </fieldType>
   [junit4]   1>        
   [junit4]   1>            <!-- A general text field that has reasonable, generic
   [junit4]   1>                 cross-language defaults: it tokenizes with StandardTokenizer,
   [junit4]   1>        	       removes stop words from case-insensitive "stopwords.txt"
   [junit4]   1>        	       (empty by default), and down cases.  At query time only, it
   [junit4]   1>        	       also applies synonyms.
   [junit4]   1>        	  -->
   [junit4]   1>            <fieldType name="text_general" class="solr.TextField" positionIncrementGap="100" multiValued="true">
   [junit4]   1>              <analyzer type="index">
   [junit4]   1>                <tokenizer class="solr.StandardTokenizerFactory"/>
   [junit4]   1>                <filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt" />
   [junit4]   1>                <!-- in this example, we will only use synonyms at query time
   [junit4]   1>                <filter class="solr.SynonymGraphFilterFactory" synonyms="index_synonyms.txt" ignoreCase="true" expand="false"/>
   [junit4]   1>                <filter class="solr.FlattenGraphFilterFactory"/>
   [junit4]   1>                -->
   [junit4]   1>                <filter class="solr.LowerCaseFilterFactory"/>
   [junit4]   1>              </analyzer>
   [junit4]   1>              <analyzer type="query">
   [junit4]   1>                <tokenizer class="solr.StandardTokenizerFactory"/>
   [junit4]   1>                <filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt" />
   [junit4]   1>                <filter class="solr.SynonymGraphFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="true"/>
   [junit4]   1>                <filter class="solr.LowerCaseFilterFactory"/>
   [junit4]   1>              </analyzer>
   [junit4]   1>            </fieldType>
   [junit4]   1>        
   [junit4]   1>            <!-- A text field with defaults appropriate for English: it tokenizes with StandardTokenizer,
   [junit4]   1>                 removes English stop words (lang/stopwords_en.txt), down cases, protects words from protwords.txt, and
   [junit4]   1>                 finally applies Porter's stemming.  The query time analyzer also applies synonyms from synonyms.txt. -->
   [junit4]   1>            <dynamicField name="*_txt_en" type="text_en"  indexed="true"  stored="true"/>
   [junit4]   1>            <fieldType name="text_en" class="solr.TextField" positionIncrementGap="100">
   [junit4]   1>              <analyzer type="index">
   [junit4]   1>                <tokenizer class="solr.StandardTokenizerFactory"/>
   [junit4]   1>                <!-- in this example, we will only use synonyms at query time
   [junit4]   1>                <filter class="solr.SynonymGraphFilterFactory" synonyms="index_synonyms.txt" ignoreCase="true" expand="false"/>
   [junit4]   1>                <filter class="solr.FlattenGraphFilterFactory"/>
   [junit4]   1>                -->
   [junit4]   1>                <!-- Case insensitive stop word removal.
   [junit4]   1>                -->
   [junit4]   1>                <filter class="solr.StopFilterFactory"
   [junit4]   1>                        ignoreCase="true"
   [junit4]   1>                        words="lang/stopwords_en.txt"
   [junit4]   1>                    />
   [junit4]   1>                <filter class="solr.LowerCaseFilterFactory"/>
   [junit4]   1>                <filter class="solr.EnglishPossessiveFilterFactory"/>
   [junit4]   1>                <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/>
   [junit4]   1>                <!-- Optionally you may want to use this less aggressive stemmer instead of PorterStemFilterFactory:
   [junit4]   1>                <filter class="solr.EnglishMinimalStemFilterFactory"/>
   [junit4]   1>        	      -->
   [junit4]   1>                <filter class="solr.PorterStemFilterFactory"/>
   [junit4]   1>              </analyzer>
   [junit4]   1>              <analyzer type="query">
   [junit4]   1>                <tokenizer class="solr.StandardTokenizerFactory"/>
   [junit4]   1>                <filter class="solr.SynonymGraphFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="true"/>
   [junit4]   1>                <filter class="solr.StopFilterFactory"
   [junit4]   1>                        ignoreCase="true"
   [junit4]   1>                        words="lang/stopwords_en.txt"
   [junit4]   1>                />
   [junit4]   1>                <filter class="solr.LowerCaseFilterFactory"/>
   [junit4]   1>                <filter class="solr.EnglishPossessiveFilterFactory"/>
   [junit4]   1>                <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/>
   [junit4]   1>                <!-- Optionally you may want to use this less aggressive stemmer instead of PorterStemFilterFactory:
   [junit4]   1>                <filter class="solr.EnglishMinimalStemFilterFactory"/>
   [junit4]   1>        	      -->
   [junit4]   1>                <filter class="solr.PorterStemFilterFactory"/>
   [junit4]   1>              </analyzer>
   [junit4]   1>            </fieldType>
   [junit4]   1>        
   [junit4]   1>            <!-- A text field with defaults appropriate for English, plus
   [junit4]   1>                 aggressive word-splitting and autophrase features enabled.
   [junit4]   1>                 This field is just like text_en, except it adds
   [junit4]   1>                 WordDelimiterGraphFilter to enable splitting and matching of
   [junit4]   1>                 words on case-change, alpha numeric boundaries, and
   [junit4]   1>                 non-alphanumeric chars.  This means certain compound word
   [junit4]   1>                 cases will work, for example query "wi fi" will match
   [junit4]   1>                 document "WiFi" or "wi-fi".
   [junit4]   1>            -->
   [junit4]   1>            <dynamicField name="*_txt_en_split" type="text_en_splitting"  indexed="true"  stored="true"/>
   [junit4]   1>            <fieldType name="text_en_splitting" class="solr.TextField" positionIncrementGap="100" autoGeneratePhraseQueries="true">
   [junit4]   1>              <analyzer type="index">
   [junit4]   1>                <tokenizer class="solr.WhitespaceTokenizerFactory"/>
   [junit4]   1>                <!-- in this example, we will only use synonyms at query time
   [junit4]   1>                <filter class="solr.SynonymGraphFilterFactory" synonyms="index_synonyms.txt" ignoreCase="true" expand="false"/>
   [junit4]   1>                -->
   [junit4]   1>                <!-- Case insensitive stop word removal.
   [junit4]   1>                -->
   [junit4]   1>                <filter class="solr.StopFilterFactory"
   [junit4]   1>                        ignoreCase="true"
   [junit4]   1>                        words="lang/stopwords_en.txt"
   [junit4]   1>                />
   [junit4]   1>                <filter class="solr.WordDelimiterGraphFilterFactory" generateWordParts="1" generateNumberParts="1" catenateWords="1" catenateNumbers="1" catenateAll="0" splitOnCaseChange="1"/>
   [junit4]   1>                <filter class="solr.LowerCaseFilterFactory"/>
   [junit4]   1>                <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/>
   [junit4]   1>                <filter class="solr.PorterStemFilterFactory"/>
   [junit4]   1>                <filter class="solr.FlattenGraphFilterFactory" />
   [junit4]   1>              </analyzer>
   [junit4]   1>              <analyzer type="query">
   [junit4]   1>                <tokenizer class="solr.WhitespaceTokenizerFactory"/>
   [junit4]   1>                <filter class="solr.SynonymGraphFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="true"/>
   [junit4]   1>                <filter class="solr.StopFilterFactory"
   [junit4]   1>                        ignoreCase="true"
   [junit4]   1>                        words="lang/stopwords_en.txt"
   [junit4]   1>                />
   [junit4]   1>                <filter class="solr.WordDelimiterGraphFilterFactory" generateWordParts="1" generateNumberParts="1" catenateWords="0" catenateNumbers="0" catenateAll="0" splitOnCaseChange="1"/>
   [junit4]   1>                <filter class="solr.LowerCaseFilterFactory"/>
   [junit4]   1>                <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/>
   [junit4]   1>                <filter class="solr.PorterStemFilterFactory"/>
   [junit4]   1>              </analyzer>
   [junit4]   1>            </fieldType>
   [junit4]   1>        
   [junit4]   1>            <!-- Less flexible matching, but less false matches.  Probably not ideal for product names,
   [junit4]   1>                 but may be good for SKUs.  Can insert dashes in the wrong place and still match. -->
   [junit4]   1>            <dynamicField name="*_txt_en_split_tight" type="text_en_splitting_tight"  indexed="true"  stored="true"/>
   [junit4]   1>            <fieldType name="text_en_splitting_tight" class="solr.TextField" positionIncrementGap="100" autoGeneratePhraseQueries="true">
   [junit4]   1>              <analyzer type="index">
   [junit4]   1>                <tokenizer class="solr.WhitespaceTokenizerFactory"/>
   [junit4]   1>                <filter class="solr.SynonymGraphFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="false"/>
   [junit4]   1>                <filter class="solr.StopFilterFactory" ignoreCase="true" words="lang/stopwords_en.txt"/>
   [junit4]   1>                <filter class="solr.WordDelimiterGraphFilterFactory" generateWordParts="0" generateNumberParts="0" catenateWords="1" catenateNumbers="1" catenateAll="0"/>
   [junit4]   1>                <filter class="solr.LowerCaseFilterFactory"/>
   [junit4]   1>                <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/>
   [junit4]   1>                <filter class="solr.EnglishMinimalStemFilterFactory"/>
   [junit4]   1>                <!-- this filter can remove any duplicate tokens that appear at the same position - sometimes
   [junit4]   1>                     possible with WordDelimiterGraphFilter in conjuncton with stemming. -->
   [junit4]   1>                <filter class="solr.RemoveDuplicatesTokenFilterFactory"/>
   [junit4]   1>                <filter class="solr.FlattenGraphFilterFactory" />
   [junit4]   1>              </analyzer>
   [junit4]   1>              <analyzer type="query">
   [junit4]   1>                <tokenizer class="solr.WhitespaceTokenizerFactory"/>
   [junit4]   1>                <filter class="solr.SynonymGraphFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="false"/>
   [junit4]   1>                <filter class="solr.StopFilterFactory" ignoreCase="true" words="lang/stopwords_en.txt"/>
   [junit4]   1>                <filter class="solr.WordDelimiterGraphFilterFactory" generateWordParts="0" generateNumberParts="0" catenateWords="1" catenateNumbers="1" catenateAll="0"/>
   [junit4]   1>                <filter class="solr.LowerCaseFilterFactory"/>
   [junit4]   1>                <filter class="solr.KeywordMarkerFilterFactory" protected="protwords.txt"/>
   [junit4]   1>                <filter class="solr.EnglishMinimalStemFilterFactory"/>
   [junit4]   1>                <!-- this filter can remove any duplicate tokens that appear at the same position - sometimes
   [junit4]   1>                     possible with WordDelimiterGraphFilter in conjuncton with stemming. -->
   [junit4]   1>                <filter class="solr.RemoveDuplicatesTokenFilterFactory"/>
   [junit4]   1>              </analyzer>
   [junit4]   1>            </fieldType>
   [junit4]   1>        
   [junit4]   1>            <!-- Just like text_general except it reverses the characters of
   [junit4]   1>        	       each token, to enable more efficient leading wildcard queries.
   [junit4]   1>            -->
   [junit4]   1>            <dynamicField name="*_txt_rev" type="text_general_rev"  indexed="true"  stored="true"/>
   [junit4]   1>            <fieldType name="text_general_rev" class="solr.TextField" positionIncrementGap="100">
   [junit4]   1>              <analyzer type="index">
   [junit4]   1>                <tokenizer class="solr.StandardTokenizerFactory"/>
   [junit4]   1>                <filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt" />
   [junit4]   1>                <filter class="solr.LowerCaseFilterFactory"/>
   [junit4]   1>                <filter class="solr.ReversedWildcardFilterFactory" withOriginal="true"
   [junit4]   1>                        maxPosAsterisk="3" maxPosQuestion="2" maxFractionAsterisk="0.33"/>
   [junit4]   1>              </analyzer>
   [junit4]   1>              <analyzer type="query">
   [junit4]   1>                <tokenizer class="solr.StandardTokenizerFactory"/>
   [junit4]   1>                <filter class="solr.SynonymGraphFilterFactory" synonyms="synonyms.txt" ignoreCase="true" expand="true"/>
   [junit4]   1>                <filter class="solr.StopFilterFactory" ignoreCase="true" words="stopwords.txt" />
   [junit4]   1>                <filter class="solr.LowerCaseFilterFactory"/>
   [junit4]   1>              </analyzer>
   [junit4]   1>            </fieldType>
   [junit4]   1>        
   [junit4]   1>            <dynamicField name="*_phon_en" type="phonetic_en"  indexed="true"  stored="true"/>
   [junit4]   1>            <fieldType name="phonetic_en" stored="false" indexed="true" class="solr.TextField" >
   [junit4]   1>              <analyzer>
   [junit4]   1>                <tokenizer class="solr.StandardTokenizerFactory"/>
   [junit4]   1>                <filter class="solr.DoubleMetaphoneFilterFactory" inject="false"/>
   [junit4]   1>              </analyzer>
   [junit4]   1>            </fieldType>
   [junit4]   1>        
   [junit4]   1>            <!-- lowercases the entire field value, keeping it as a single token.  -->
   [junit4]   1>            <dynamicField name="*_s_lower" type="lowercase"  indexed="true"  stored="true"/>
   [junit4]   1>            <fieldType name="lowercase" class="solr.TextField" positionIncrementGap="100">
   [junit4]   1>              <analyzer>
   [junit4]   1>                <tokenizer class="solr.KeywordTokenizerFactory"/>
   [junit4]   1>                <filter class="solr.LowerCaseFilterFactory" />
   [junit4]   1>              </analyzer>
   [junit4]   1>            </fieldType>
   [junit4]   1>        
   [junit4]   1>            <!-- 
   [junit4]   1>              Example of using PathHierarchyTokenizerFactory at index time, so


[...truncated too long message...]

ed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J1-20170825_003759_7826600674258813169964.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J0-20170825_003759_7828628856595994207087.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 499 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20170825_003837_7948040998793512164505.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20170825_003837_79414302069182692687679.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20170825_003837_79417322821400165408717.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1131 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20170825_003855_3538604762173444037113.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20170825_003855_35314981160507081030213.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 593 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20170825_003902_17711497204110943809698.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20170825_003902_1778974506950683477849.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20170825_003902_17710764158490857184942.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 503 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20170825_003923_9103047908375078804343.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20170825_003923_9178058927761921312644.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20170825_003923_9168198147835945832647.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 507 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20170825_003934_13711162798063629243521.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20170825_003934_13717699560131051546565.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 586 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20170825_003941_04515249807494500936332.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20170825_003941_0454038483469122370853.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20170825_003941_0452106650042759170026.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 538 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20170825_004023_6271728166533581048587.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20170825_004023_6271696542709488793283.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 494 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20170825_004034_9851873209782401838117.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 28972 lines...]

[JENKINS-EA] Lucene-Solr-master-Linux (32bit/jdk-9-ea+181) - Build # 20368 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20368/
Java: 32bit/jdk-9-ea+181 -client -XX:+UseConcMarkSweepGC --illegal-access=deny

2 tests failed.
FAILED:  org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testExecutorStream

Error Message:
Error from server at https://127.0.0.1:33587/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason: <pre>    Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:33587/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason:
<pre>    Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([A3CF3EEADB0C1485:810FBF11F8663E95]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
	at org.apache.solr.client.solrj.io.stream.StreamExpressionTest.testExecutorStream(StreamExpressionTest.java:6815)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:33587/solr/workQueue_shard2_replica_n3: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/workQueue_shard2_replica_n3/update. Reason:
<pre>    Can not find: /solr/workQueue_shard2_replica_n3/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	... 1 more


FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
No 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: No 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([61420E83F7FE7D1F:3EA623B49CF2EE5A]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:85)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1692 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J2-20170824_183121_88811347422738627832020.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J0-20170824_183121_8863490443587653754316.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J1-20170824_183121_88616609995423068656671.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 285 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J1-20170824_183853_84511594070650153131286.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J0-20170824_183853_8456764065357432531268.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J2-20170824_183853_8452345813984552959992.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 1033 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20170824_184026_32513146231050641396489.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20170824_184026_3259252977359497237812.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 4 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20170824_184026_3259379953920163776543.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 207 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20170824_184426_24414584734806017143615.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20170824_184426_23812441615703113294006.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20170824_184426_2388152410659688415557.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 229 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20170824_184438_82516494809914963813633.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 11 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20170824_184438_82516558271172596331173.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20170824_184438_82516347395705213320913.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 146 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20170824_184515_14416079983973265193207.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20170824_184515_14510528990145700116325.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20170824_184515_1444921632677591398824.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 155 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20170824_184519_1103445037430158016059.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20170824_184519_11010113122578315644888.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20170824_184519_1108729575927248500890.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 145 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20170824_184529_93713690633417319294942.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20170824_184529_9371902296051638252343.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 146 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20170824_184542_4311090041756950601135.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20170824_184542_4313765910208100501402.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20170824_184542_43117073019112752614780.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 161 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20170824_184545_3654144397356510203961.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 145 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20170824_184553_6725330049256932179636.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20170824_184553_6729805845353903719326.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 25 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20170824_184553_6729555777358127635224.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 1209 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J1-20170824_184604_7774163519774820841117.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J2-20170824_184604_7779924731386167604314.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J0-20170824_184604_777342125636493775926.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 223 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J1-20170824_184613_90213675784188693119598.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J0-20170824_184613_9024000756462259108037.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J2-20170824_184613_9039103023833113009061.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 248 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J0-20170824_184627_50610122530146451259699.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20170824_184627_5062795687126241788688.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 7 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J1-20170824_184627_50616078911442020164662.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 229 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J1-20170824_184926_133998713211385631917.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J2-20170824_184926_1338196281765263914509.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J0-20170824_184926_1339814608440612657300.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 162 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J1-20170824_184928_95615166657707846040335.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J0-20170824_184928_95617277049978550942631.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J2-20170824_184928_9562828351513032769087.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 210 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J2-20170824_184935_3328081508780027580157.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J1-20170824_184935_3327150326801148722192.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J0-20170824_184935_33217661507241338575810.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 168 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J2-20170824_185005_25614496125924088188806.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J0-20170824_185005_25617988601158111339303.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J1-20170824_185005_256510310833323437.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 232 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J2-20170824_185024_8752537257705198979541.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J1-20170824_185024_8745510866412269094260.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J0-20170824_185024_87417293595391332227066.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 152 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J2-20170824_185043_53914208187743795224211.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J0-20170824_185043_5394109953624839490637.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J1-20170824_185043_53910440880816897367944.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 141 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J0-20170824_185115_22711908276129339463817.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J1-20170824_185115_2279934400301351927901.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 170 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J0-20170824_185127_0302503579992547190838.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J1-20170824_185127_03012945591387602644129.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J2-20170824_185127_0309908700228663880408.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 307 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J1-20170824_185143_29218283808443609716518.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J0-20170824_185143_29214780706240905899550.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J2-20170824_185143_2921760281159252153340.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 222 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J0-20170824_185149_8358051728619794666476.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J1-20170824_185149_8355341600601571944162.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J2-20170824_185149_8358757756668922278567.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 199 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J1-20170824_185156_16313200213297865753561.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J2-20170824_185156_163642297312097192396.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J0-20170824_185156_1636799131180124982928.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 182 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J1-20170824_185206_78416674876596005641598.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 21 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J0-20170824_185206_7844121000742467779201.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 7 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J2-20170824_185206_784785577958023684417.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 207 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20170824_185307_03713660421553005508734.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20170824_185307_0376561070201693025948.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20170824_185307_0379255685748836640378.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 140 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial/test/temp/junit4-J0-20170824_185319_17115444604120860429804.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 157 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20170824_185321_45513389408629652156786.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20170824_185321_455224278293667996990.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20170824_185321_45516321989819136065755.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 230 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J0-20170824_185442_3622595757019509734380.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J2-20170824_185442_36217514043110439481352.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 18 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J1-20170824_185442_36212628739037868728670.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3401 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_61420E83F7FE7D1F-001/init-core-data-001
   [junit4]   2> 2137071 WARN  (SUITE-SolrSlf4jReporterTest-seed#[61420E83F7FE7D1F]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=44 numCloses=44
   [junit4]   2> 2137072 INFO  (SUITE-SolrSlf4jReporterTest-seed#[61420E83F7FE7D1F]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2137072 INFO  (SUITE-SolrSlf4jReporterTest-seed#[61420E83F7FE7D1F]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 2137072 INFO  (SUITE-SolrSlf4jReporterTest-seed#[61420E83F7FE7D1F]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2137074 INFO  (TEST-SolrSlf4jReporterTest.testReporter-seed#[61420E83F7FE7D1F]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testReporter
   [junit4]   2> 2143380 INFO  (TEST-SolrSlf4jReporterTest.testReporter-seed#[61420E83F7FE7D1F]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testReporter
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=61420E83F7FE7D1F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=gsw-CH -Dtests.timezone=Europe/Vienna -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 6.31s J1 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: No 'solr.node' logs in: {numFound=0,start=0,docs=[]}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([61420E83F7FE7D1F:3EA623B49CF2EE5A]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:85)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 2143384 INFO  (SUITE-SolrSlf4jReporterTest-seed#[61420E83F7FE7D1F]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_61420E83F7FE7D1F-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=true): {}, locale=gsw-CH, timezone=Europe/Vienna
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 9 (32-bit)/cpus=8,threads=1,free=261768616,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [CollectionsAPIDistributedZkTest, DeleteReplicaTest, FileBasedSpellCheckerTest, TestNumericTerms32, TestScoreJoinQPNoScore, VersionInfoTest, UpdateRequestProcessorFactoryTest, TestRawResponseWriter, TestNumericTokenStream, BasicFunctionalityTest, SoftAutoCommitTest, LargeFieldTest, BadComponentTest, NoCacheHeaderTest, TestRTGBase, JSONWriterTest, TestSolrCloudWithDelegationTokens, CollectionStateFormat2Test, HighlighterTest, CoreAdminHandlerTest, TestSolrCoreSnapshots, TestBlobHandler, DistributedIntervalFacetingTest, DeleteInactiveReplicaTest, ZkControllerTest, MetricUtilsTest, IndexSchemaRuntimeFieldTest, TestBackupRepositoryFactory, OverseerModifyCollectionTest, TestLegacyFieldReuse, TestSolrIndexConfig, TestJsonFacetRefinement, SliceStateTest, DirectSolrConnectionTest, TestCharFilters, TestTrieFacet, SchemaVersionSpecificBehaviorTest, LoggingHandlerTest, AtomicUpdatesTest, MissingSegmentRecoveryTest, TlogReplayBufferedWhileIndexingTest, TestPostingsSolrHighlighter, TestGraphMLResponseWriter, TestHashQParserPlugin, SharedFSAutoReplicaFailoverUtilsTest, SubstringBytesRefFilterTest, TestSchemaVersionResource, TestRequestForwarding, DisMaxRequestHandlerTest, TestNoOpRegenerator, CdcrReplicationHandlerTest, DistributedFacetPivotLongTailTest, ForceLeaderTest, TestDistributedGrouping, TestPullReplica, MoreLikeThisHandlerTest, TestSolrCloudWithHadoopAuthPlugin, OverseerTaskQueueTest, ClusterStateUpdateTest, TestHalfAndHalfDocValues, BadCopyFieldTest, TestRandomRequestDistribution, TestQueryTypes, TestExactSharedStatsCache, SolrGraphiteReporterTest, AssignBackwardCompatibilityTest, TestValueSourceCache, TestMaxTokenLenTokenizer, ReplicaListTransformerTest, LeaderInitiatedRecoveryOnCommitTest, ConnectionReuseTest, QueryParsingTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, ImplicitSnitchTest, TestSubQueryTransformerDistrib, StatelessScriptUpdateProcessorFactoryTest, TermVectorComponentTest, TestLRUCache, TestSweetSpotSimilarityFactory, TestPartialUpdateDeduplication, TestSmileRequest, TestFieldCacheVsDocValues, HdfsLockFactoryTest, TestClusterStateMutator, SortSpecParsingTest, BlockDirectoryTest, PrimUtilsTest, AnalysisAfterCoreReloadTest, DistributedMLTComponentTest, BasicAuthIntegrationTest, CacheHeaderTest, ExitableDirectoryReaderTest, TestTlogReplica, TestSha256AuthenticationProvider, ResourceLoaderTest, TestCustomDocTransformer, TestHashPartitioner, TestReloadAndDeleteDocs, TestMultiValuedNumericRangeQuery, ChaosMonkeyNothingIsSafeWithPullReplicasTest, TestStreamBody, DistribCursorPagingTest, SpatialFilterTest, TestLeaderInitiatedRecoveryThread, ScriptEngineTest, TestDFISimilarityFactory, TestMaxScoreQueryParser, TestStressRecovery, ConnectionManagerTest, SolrCloudExampleTest, BlobRepositoryCloudTest, BlockJoinFacetDistribTest, ConvertedLegacyTest, TestXIncludeConfig, TestElisionMultitermQuery, TestDynamicFieldCollectionResource, TestPerFieldSimilarity, TestSearchPerf, TestOrdValues, WrapperMergePolicyFactoryTest, TestReloadDeadlock, TestUnifiedSolrHighlighter, CSVRequestHandlerTest, HighlighterConfigTest, SOLR749Test, TestQuerySenderListener, UpdateParamsTest, AlternateDirectoryTest, TestQuerySenderNoQuery, ResponseLogComponentTest, TestSolrDeletionPolicy2, SampleTest, TestDocSet, TestBinaryField, NumericFieldsTest, TestConfig, TestFuzzyAnalyzedSuggestions, TestSolrCoreProperties, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, SpellPossibilityIteratorTest, TestCodecSupport, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, TimeZoneUtilsTest, OpenExchangeRatesOrgProviderTest, PluginInfoTest, TestFastLRUCache, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, CreateCollectionCleanupTest, DeleteNodeTest, DeleteStatusTest, DistributedVersionInfoTest, LeaderElectionContextKeyTest, MigrateRouteKeyTest, MoveReplicaHDFSUlogDirTest, PeerSyncReplicationTest, SolrXmlInZkTest, TestCloudPivotFacet, TestClusterProperties, TestCollectionsAPIViaSolrCloudCluster, TestConfigSetsAPIZkFailure, TestDistribDocBasedVersion, TestDownShardTolerantSearch, TestHdfsCloudBackupRestore, TestLeaderElectionWithEmptyReplica, TestLeaderElectionZkExpiry, TestLocalFSCloudBackupRestore, TestLockTree, TestMiniSolrCloudClusterSSL, TestPullReplicaErrorHandling, TestRandomFlRTGCloud, TestSSLRandomization, TestShortCircuitedRequests, TestStressCloudBlindAtomicUpdates, TriLevelCompositeIdRoutingTest, TestPolicyCloud, HdfsRecoverLeaseTest, ZkStateReaderTest, RuleEngineTest, RulesTest, TestInfoStreamLogging, TestInitParams, TestSimpleTextCodec, TestSolrConfigHandler, TestRestoreCore, TestSolrConfigHandlerConcurrent, V2StandaloneTest, CoreAdminCreateDiscoverTest, CoreMergeIndexesAdminHandlerTest, InfoHandlerTest, MetricsHandlerTest, SecurityConfHandlerTest, StatsReloadRaceTest, DistributedFacetPivotSmallAdvancedTest, DistributedFacetPivotWhiteBoxTest, ShufflingReplicaListTransformerTest, SpatialHeatmapFacetsTest, SolrSlf4jReporterTest]
   [junit4] Completed [626/732 (1!)] on J1 in 6.36s, 1 test, 1 failure <<< FAILURES!

[...truncated 406 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J0-20170824_185543_80818403189515422971844.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J1-20170824_185543_80817329821574305850416.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/temp/junit4-J2-20170824_185543_80811931225427059854643.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 812 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J2-20170824_193502_29417262374471400291650.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/temp/junit4-J0-20170824_193502_29412361097908972657835.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] Suite: org.apache.solr.client.solrj.io.stream.StreamExpressionTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_A3CF3EEADB0C1485-001/init-core-data-001
   [junit4]   2> 87034 WARN  (SUITE-StreamExpressionTest-seed#[A3CF3EEADB0C1485]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=4 numCloses=4
   [junit4]   2> 87034 INFO  (SUITE-StreamExpressionTest-seed#[A3CF3EEADB0C1485]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 87035 INFO  (SUITE-StreamExpressionTest-seed#[A3CF3EEADB0C1485]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", value=0.0/0.0, ssl=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 87035 INFO  (SUITE-StreamExpressionTest-seed#[A3CF3EEADB0C1485]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 87036 INFO  (SUITE-StreamExpressionTest-seed#[A3CF3EEADB0C1485]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_A3CF3EEADB0C1485-001/tempDir-001
   [junit4]   2> 87036 INFO  (SUITE-StreamExpressionTest-seed#[A3CF3EEADB0C1485]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 87036 INFO  (Thread-336) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 87036 INFO  (Thread-336) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 87042 ERROR (Thread-336) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 87137 INFO  (SUITE-StreamExpressionTest-seed#[A3CF3EEADB0C1485]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:42171
   [junit4]   2> 87169 INFO  (jetty-launcher-247-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 87169 INFO  (jetty-launcher-247-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 87176 INFO  (jetty-launcher-247-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 87183 INFO  (jetty-launcher-247-thread-4) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 87210 INFO  (jetty-launcher-247-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@10d366{/solr,null,AVAILABLE}
   [junit4]   2> 87213 INFO  (jetty-launcher-247-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@147491{SSL,[ssl, http/1.1]}{127.0.0.1:41671}
   [junit4]   2> 87213 INFO  (jetty-launcher-247-thread-1) [    ] o.e.j.s.Server Started @90204ms
   [junit4]   2> 87213 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41671}
   [junit4]   2> 87213 ERROR (jetty-launcher-247-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 87213 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 87213 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 87213 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 87213 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-24T19:36:32.540860Z
   [junit4]   2> 87224 INFO  (jetty-launcher-247-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1e07bc5{/solr,null,AVAILABLE}
   [junit4]   2> 87235 INFO  (jetty-launcher-247-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@120bf4a{/solr,null,AVAILABLE}
   [junit4]   2> 87239 INFO  (jetty-launcher-247-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@41e629{SSL,[ssl, http/1.1]}{127.0.0.1:36541}
   [junit4]   2> 87239 INFO  (jetty-launcher-247-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@15beed2{/solr,null,AVAILABLE}
   [junit4]   2> 87239 INFO  (jetty-launcher-247-thread-2) [    ] o.e.j.s.Server Started @90230ms
   [junit4]   2> 87239 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36541}
   [junit4]   2> 87239 ERROR (jetty-launcher-247-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 87239 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 87239 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 87239 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 87239 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-24T19:36:32.566568Z
   [junit4]   2> 87239 INFO  (jetty-launcher-247-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@d2b416{SSL,[ssl, http/1.1]}{127.0.0.1:41617}
   [junit4]   2> 87239 INFO  (jetty-launcher-247-thread-4) [    ] o.e.j.s.Server Started @90230ms
   [junit4]   2> 87239 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41617}
   [junit4]   2> 87239 ERROR (jetty-launcher-247-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 87240 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 87240 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 87240 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 87240 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-24T19:36:32.567107Z
   [junit4]   2> 87259 INFO  (jetty-launcher-247-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@13d5327{SSL,[ssl, http/1.1]}{127.0.0.1:33587}
   [junit4]   2> 87259 INFO  (jetty-launcher-247-thread-3) [    ] o.e.j.s.Server Started @90250ms
   [junit4]   2> 87259 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33587}
   [junit4]   2> 87259 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 87259 ERROR (jetty-launcher-247-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 87259 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 87259 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 87259 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 87259 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-24T19:36:32.586891Z
   [junit4]   2> 87334 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 87334 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 87349 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42171/solr
   [junit4]   2> 87369 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 87371 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42171/solr
   [junit4]   2> 87374 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42171/solr
   [junit4]   2> 87435 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e15beff6c0005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 87455 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42171/solr
   [junit4]   2> 87457 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e15beff6c0007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 87555 WARN  (jetty-launcher-247-thread-1) [    ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
   [junit4]   2> 87569 WARN  (jetty-launcher-247-thread-2) [    ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
   [junit4]   2> 87569 WARN  (jetty-launcher-247-thread-4) [    ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
   [junit4]   2> 87572 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 87573 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:36541_solr
   [junit4]   2> 87574 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 87574 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.c.Overseer Overseer (id=98540151921967113-127.0.0.1:36541_solr-n_0000000000) starting
   [junit4]   2> 87576 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41617_solr
   [junit4]   2> 87579 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 87584 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41671_solr
   [junit4]   2> 87601 INFO  (zkCallback-266-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 87626 INFO  (zkCallback-268-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 87642 INFO  (zkCallback-267-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 87678 WARN  (jetty-launcher-247-thread-3) [    ] o.a.s.c.ZkController The _default configset could not be uploaded. Please provide 'solr.default.confdir' parameter that points to a configset intended to be the default. Current 'solr.default.confdir' value: null
   [junit4]   2> 87679 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 87690 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36541_solr
   [junit4]   2> 87691 INFO  (zkCallback-267-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 87691 INFO  (zkCallback-268-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 87691 INFO  (zkCallback-266-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 87701 INFO  (zkCallback-269-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 87702 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 87703 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33587_solr
   [junit4]   2> 87705 INFO  (zkCallback-268-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 87705 INFO  (zkCallback-266-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 87705 INFO  (zkCallback-267-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 87708 INFO  (zkCallback-269-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 87791 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41617.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87800 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41617.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87800 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41617.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87802 INFO  (jetty-launcher-247-thread-4) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_A3CF3EEADB0C1485-001/tempDir-001/node4/.
   [junit4]   2> 87804 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41671.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87818 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41671.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87818 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41671.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87819 INFO  (jetty-launcher-247-thread-1) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_A3CF3EEADB0C1485-001/tempDir-001/node1/.
   [junit4]   2> 87836 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36541.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87839 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33587.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87850 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36541.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87850 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36541.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87852 INFO  (jetty-launcher-247-thread-2) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_A3CF3EEADB0C1485-001/tempDir-001/node2/.
   [junit4]   2> 87856 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33587.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87856 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33587.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 87857 INFO  (jetty-launcher-247-thread-3) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_A3CF3EEADB0C1485-001/tempDir-001/node3/.
   [junit4]   2> 87971 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e15beff6c000d, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 87975 INFO  (SUITE-StreamExpressionTest-seed#[A3CF3EEADB0C1485]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 87976 INFO  (SUITE-StreamExpressionTest-seed#[A3CF3EEADB0C1485]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42171/solr ready
   [junit4]   2> 88014 INFO  (qtp8224661-1319) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 88015 INFO  (OverseerThreadFactory-475-thread-1) [    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 88119 INFO  (OverseerStateUpdate-98540151921967113-127.0.0.1:36541_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"collection1_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:36541/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 88121 INFO  (OverseerStateUpdate-98540151921967113-127.0.0.1:36541_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"collection1_shard2_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41671/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 88348 INFO  (qtp18104036-1325) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=collection1_shard2_replica_n2&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 88348 INFO  (qtp18104036-1325) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 88349 INFO  (qtp28350458-1301) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 88349 INFO  (qtp28350458-1301) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 88457 INFO  (zkCallback-266-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 88457 INFO  (zkCallback-267-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 88457 INFO  (zkCallback-267-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 88457 INFO  (zkCallback-266-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 89362 INFO  (qtp18104036-1325) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 89362 INFO  (qtp28350458-1301) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 89374 INFO  (qtp28350458-1301) [    ] o.a.s.s.IndexSchema [collection1_shard1_replica_n1] Schema name=test
   [junit4]   2> 89374 INFO  (qtp18104036-1325) [    ] o.a.s.s.IndexSchema [collection1_shard2_replica_n2] Schema name=test
   [junit4]   2> 89433 WARN  (qtp28350458-1301) [    ] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 89434 WARN  (qtp28350458-1301) [    ] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 89434 INFO  (qtp28350458-1301) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 89434 INFO  (qtp28350458-1301) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from collection collection1, trusted=true
   [junit4]   2> 89434 INFO  (qtp28350458-1301) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36541.solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 89435 INFO  (qtp28350458-1301) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 89435 INFO  (qtp28350458-1301) [    ] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_A3CF3EEADB0C1485-001/tempDir-001/node2/collection1_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_A3CF3EEADB0C1485-001/tempDir-001/node2/./collection1_shard1_replica_n1/data/]
   [junit4]   2> 89446 WARN  (qtp18104036-1325) [    ] o.a.s.s.IndexSchema Field lowerfilt1and2 is not multivalued and destination for multiple copyFields (2)
   [junit4]   2> 89446 WARN  (qtp18104036-1325) [    ] o.a.s.s.IndexSchema Field text is not multivalued and destination for multiple copyFields (3)
   [junit4]   2> 89446 INFO  (qtp18104036-1325) [    ] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
   [junit4]   2> 89446 INFO  (qtp18104036-1325) [    ] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n2' using configuration from collection collection1, trusted=true
   [junit4]   2> 89447 INFO  (qtp18104036-1325) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41671.solr.core.collection1.shard2.replica_n2' (registry 'solr.core.collection1.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@2e81b9
   [junit4]   2> 89447 INFO  (qtp18104036-1325) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 89447 INFO  (qtp18104036-1325) [    ] o.a.s.c.SolrCore [[collection1_shard2_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_A3CF3EEADB0C1485-001/tempDir-001/node1/collection1_shard2_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-solrj/test/J1/temp/solr.client.solrj.io.stream.StreamExpressionTest_A3CF3EEADB0C1485-001/tempDir-001/node1/./collection1_shard2_replica_n2/data/]
   [junit4]   2> 89496 INFO  (qtp28350458-1301) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 89496 INFO  (qtp28350458-1301) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 89497 INFO  (qtp28350458-1301) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 89497 INFO  (qtp28350458-1301) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 89499 INFO  (qtp28350458-1301) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1a62d99[collection1_shard1_replica_n1] main]
   [junit4]   2> 89501 INFO  (qtp28350458-1301) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 89501 INFO  (qtp28350458-1301) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 89502 INFO  (qtp28350458-1301) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 89503 INFO  (searcherExecutor-484-thread-1) [    ] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@1a62d99[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 89503 INFO  (qtp28350458-1301) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576642433337262080
   [junit4]   2> 89503 INFO  (qtp18104036-1325) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 89503 INFO  (qtp18104036-1325) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 89504 INFO  (qtp18104036-1325) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 89504 INFO  (qtp18104036-1325) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 89506 INFO  (qtp18104036-1325) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@17d8b36[collection1_shard2_replica_n2] main]
   [junit4]   2> 89507 INFO  (qtp18104036-1325) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
   [junit4]   2> 89507 INFO  (qtp18104036-1325) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
   [junit4]   2> 89508 INFO  (qtp18104036-1325) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 89510 INFO  (qtp28350458-1301) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 89510 INFO  (qtp28350458-1301) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 89510 INFO  (qtp28350458-1301) [    ] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:36541/solr/collection1_shard1_replica_n1/
   [junit4]   2> 89510 INFO  (qtp28350458-1301) [    ] o.a.s.c.SyncStrat

[...truncated too long message...]

and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J0-20170824_193831_95814150958416251682510.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J1-20170824_193831_95814663337014131519245.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 499 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20170824_193905_17214372385380945590662.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20170824_193905_17212208228310861999865.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20170824_193905_17216523894204899722736.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1131 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20170824_193920_8881428468762211026995.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20170824_193920_88815402964303382271114.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 596 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20170824_193927_3681175565333644447826.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20170824_193927_3689403273799371191921.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20170824_193927_3685539278169528097310.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 503 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20170824_193949_77210819704766017546541.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20170824_193949_7723135825504111909639.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20170824_193949_77210824037239141603317.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 507 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20170824_193959_9276347319802416559745.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20170824_193959_92710255254287368858676.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 589 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20170824_194006_9384405596031471423648.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20170824_194006_938248995830591661248.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20170824_194006_9383142622112752295992.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 538 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20170824_194039_07417171033223492760609.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20170824_194039_0745574680671462004130.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 494 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20170824_194049_88312326093175277550509.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 28972 lines...]

[JENKINS-EA] Lucene-Solr-master-Linux (32bit/jdk-9-ea+181) - Build # 20367 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20367/
Java: 32bit/jdk-9-ea+181 -client -XX:+UseSerialGC --illegal-access=deny

2 tests failed.
FAILED:  org.apache.solr.cloud.CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster

Error Message:
Document mismatch on target after sync expected:<2000> but was:<1990>

Stack Trace:
java.lang.AssertionError: Document mismatch on target after sync expected:<2000> but was:<1990>
	at __randomizedtesting.SeedInfo.seed([EBF058479CCCE58A:3FB5131E7B9A5671]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster(CdcrBootstrapTest.java:309)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping

Error Message:
Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.

Stack Trace:
java.lang.AssertionError: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
	at __randomizedtesting.SeedInfo.seed([EBF058479CCCE58A:9A14A691EA27C246]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12231 lines...]
   [junit4] Suite: org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_EBF058479CCCE58A-001/init-core-data-001
   [junit4]   2> 1518301 WARN  (SUITE-UpdateRequestProcessorFactoryTest-seed#[EBF058479CCCE58A]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 1518301 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[EBF058479CCCE58A]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1518302 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[EBF058479CCCE58A]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 1518302 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[EBF058479CCCE58A]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1518302 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[EBF058479CCCE58A]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore
   [junit4]   2> 1518529 WARN  (coreLoadExecutor-4981-thread-1) [    ] o.a.s.c.RequestHandlers no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 1518530 WARN  (coreLoadExecutor-4981-thread-1) [    ] o.a.s.r.ManagedResourceStorage Cannot write to config directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> 1518531 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[EBF058479CCCE58A]-worker) [    ] o.a.s.SolrTestCaseJ4 ####initCore end
   [junit4]   2> 1518533 INFO  (TEST-UpdateRequestProcessorFactoryTest.testRequestTimeUrp-seed#[EBF058479CCCE58A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testRequestTimeUrp
   [junit4]   2> 1518534 INFO  (TEST-UpdateRequestProcessorFactoryTest.testRequestTimeUrp-seed#[EBF058479CCCE58A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testRequestTimeUrp
   [junit4]   2> 1518535 INFO  (TEST-UpdateRequestProcessorFactoryTest.testConfiguration-seed#[EBF058479CCCE58A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testConfiguration
   [junit4]   2> 1518535 INFO  (TEST-UpdateRequestProcessorFactoryTest.testConfiguration-seed#[EBF058479CCCE58A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testConfiguration
   [junit4]   2> 1518536 INFO  (TEST-UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping-seed#[EBF058479CCCE58A]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testUpdateDistribChainSkipping
   [junit4]   2> 1518536 INFO  (TEST-UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping-seed#[EBF058479CCCE58A]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testUpdateDistribChainSkipping
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UpdateRequestProcessorFactoryTest -Dtests.method=testUpdateDistribChainSkipping -Dtests.seed=EBF058479CCCE58A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=kok -Dtests.timezone=Asia/Hovd -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 0.00s J1 | UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EBF058479CCCE58A:9A14A691EA27C246]:0)
   [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1518538 INFO  (SUITE-UpdateRequestProcessorFactoryTest-seed#[EBF058479CCCE58A]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_EBF058479CCCE58A-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=727, maxMBSortInHeap=5.846679592079808, sim=RandomSimilarity(queryNorm=true): {}, locale=kok, timezone=Asia/Hovd
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 9 (32-bit)/cpus=8,threads=1,free=273675960,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestInfoStreamLogging, TestRestManager, SortSpecParsingTest, ExitableDirectoryReaderTest, OpenCloseCoreStressTest, TestDocBasedVersionConstraints, TestDistribDocBasedVersion, TestLeaderInitiatedRecoveryThread, TestSearchPerf, TestNoOpRegenerator, TestComplexPhraseLeadingWildcard, ConvertedLegacyTest, TestChildDocTransformer, TestXIncludeConfig, TestSweetSpotSimilarityFactory, HdfsRecoverLeaseTest, TestDynamicFieldCollectionResource, HdfsSyncSliceTest, PropertiesRequestHandlerTest, TestSolrConfigHandler, TestClusterStateMutator, SharedFSAutoReplicaFailoverUtilsTest, TestInPlaceUpdatesDistrib, TestHashPartitioner, SolrSlf4jReporterTest, TestSolrCoreSnapshots, TestLRUCache, TestCloudPivotFacet, TestStreamBody, TestTrieFacet, FileUtilsTest, SpatialFilterTest, DistributedFacetPivotLongTailTest, JsonLoaderTest, CollectionStateFormat2Test, TestReloadDeadlock, TestBackupRepositoryFactory, TestOrdValues, TestPullReplica, NoCacheHeaderTest, TestSolrJ, SpellCheckComponentTest, OverseerTaskQueueTest, TestPerFieldSimilarity, TestCoreDiscovery, CSVRequestHandlerTest, BlobRepositoryCloudTest, TestMaxTokenLenTokenizer, TestStressVersions, QueryParsingTest, BadComponentTest, SubstringBytesRefFilterTest, ScriptEngineTest, MissingSegmentRecoveryTest, TestUnifiedSolrHighlighter, TestSolrCloudWithHadoopAuthPlugin, TestRTGBase, StatelessScriptUpdateProcessorFactoryTest, LeaderElectionContextKeyTest, BadCopyFieldTest, ConnectionManagerTest, TestExpandComponent, CleanupOldIndexTest, TestCursorMarkWithoutUniqueKey, HdfsLockFactoryTest, ChaosMonkeySafeLeaderTest, TestPayloadScoreQParserPlugin, TestCloudManagedSchema, TestBlobHandler, ZkCLITest, DeleteInactiveReplicaTest, AnalyticsMergeStrategyTest, SolrGraphiteReporterTest, TestConfigsApi, PrimUtilsTest, VersionInfoTest, TestBM25SimilarityFactory, AddBlockUpdateTest, TestHdfsCloudBackupRestore, HdfsUnloadDistributedZkTest, TestDistributedGrouping, ZkFailoverTest, IndexSchemaTest, TestHalfAndHalfDocValues, DataDrivenBlockJoinTest, DocValuesTest, DistributedIntervalFacetingTest, CurrencyFieldTypeTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestSchemalessBufferedUpdates, MetricUtilsTest, CoreAdminHandlerTest, TestExactSharedStatsCache, DirectSolrConnectionTest, TestJsonFacetRefinement, CdcrReplicationHandlerTest, TestMiniSolrCloudClusterSSL, OutOfBoxZkACLAndCredentialsProvidersTest, TestAtomicUpdateErrorCases, TestMaxScoreQueryParser, IndexSchemaRuntimeFieldTest, CollectionsAPISolrJTest, TestStressCloudBlindAtomicUpdates, ChaosMonkeyNothingIsSafeWithPullReplicasTest, DirectSolrSpellCheckerTest, TestCloudDeleteByQuery, ShardRoutingCustomTest, TestCustomStream, ZkSolrClientTest, FileBasedSpellCheckerTest, TestCharFilters, TestAnalyzeInfixSuggestions, BlockJoinFacetDistribTest, TestMultiValuedNumericRangeQuery, CollectionsAPIDistributedZkTest, TestRawResponseWriter, TestReplicationHandlerBackup, TestConfigSetsAPIZkFailure, TestSolrCLIRunExample, SimplePostToolTest, AnalysisAfterCoreReloadTest, SignatureUpdateProcessorFactoryTest, SolrRequestParserTest, TestFoldingMultitermQuery, SuggesterTSTTest, TestStressLucene, TestTrie, TestCSVLoader, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestUpdate, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, DirectUpdateHandlerOptimizeTest, SortByFunctionTest, TestRemoteStreaming, DocValuesMultiTest, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoBeanTest, XsltUpdateRequestHandlerTest, DebugComponentTest, CacheHeaderTest, LukeRequestHandlerTest, DisMaxRequestHandlerTest, TestReversedWildcardFilterFactory, TestQueryTypes, PrimitiveFieldTypeTest, TestOmitPositions, TermsComponentTest, RequestHandlersTest, TestValueSourceCache, TermVectorComponentTest, TestIndexingPerformance, MoreLikeThisHandlerTest, RequiredFieldsTest, FieldAnalysisRequestHandlerTest, TestSolrQueryParser, FastVectorHighlighterTest, LoggingHandlerTest, RegexBoostProcessorTest, ReturnFieldsTest, UpdateRequestProcessorFactoryTest]
   [junit4] Completed [439/732 (1!)] on J1 in 0.28s, 3 tests, 1 failure <<< FAILURES!

[...truncated 231 lines...]
   [junit4] Suite: org.apache.solr.cloud.CdcrBootstrapTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrBootstrapTest_EBF058479CCCE58A-001/init-core-data-001
   [junit4]   2> 1639323 WARN  (SUITE-CdcrBootstrapTest-seed#[EBF058479CCCE58A]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=11 numCloses=11
   [junit4]   2> 1639330 ERROR (Thread-4758) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1639434 ERROR (jetty-launcher-4121-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> Target zkHost = 127.0.0.1:41603/solr
   [junit4]   2> 1639570 ERROR (Thread-4768) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1639679 ERROR (jetty-launcher-4133-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> Adding 10 docs with commit=true, numDocs=100
   [junit4]   1> Adding 10 docs with commit=true, numDocs=200
   [junit4]   1> Adding 10 docs with commit=true, numDocs=300
   [junit4]   1> Adding 10 docs with commit=true, numDocs=400
   [junit4]   1> Adding 10 docs with commit=true, numDocs=500
   [junit4]   1> Adding 10 docs with commit=true, numDocs=600
   [junit4]   1> Adding 10 docs with commit=true, numDocs=700
   [junit4]   1> Adding 10 docs with commit=true, numDocs=800
   [junit4]   1> Adding 10 docs with commit=true, numDocs=900
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1000
   [junit4]   1> Cdcr queue response: {responseHeader={status=0,QTime=1},queues={127.0.0.1:41603/solr={cdcr-target={queueSize=1010,lastTimestamp=}}},tlogTotalSize=47659,tlogTotalCount=10,updateLogSynchronizer=stopped}
   [junit4]   2> 1650987 WARN  (cdcr-bootstrap-status-4152-thread-1) [    ] o.a.s.h.CdcrReplicatorManager Cancelling waiting for bootstrap on target: cdcr-target shard: shard1 to complete
   [junit4]   1> Adding 100 docs with commit=true, numDocs=1100
   [junit4]   1> Adding 100 docs with commit=true, numDocs=1200
   [junit4]   1> Adding 100 docs with commit=true, numDocs=1300
   [junit4]   1> Adding 100 docs with commit=true, numDocs=1400
   [junit4]   1> Adding 100 docs with commit=true, numDocs=1500
   [junit4]   1> Adding 100 docs with commit=true, numDocs=1600
   [junit4]   1> Adding 100 docs with commit=true, numDocs=1700
   [junit4]   1> Adding 100 docs with commit=true, numDocs=1800
   [junit4]   1> Adding 100 docs with commit=true, numDocs=1900
   [junit4]   1> Adding 100 docs with commit=true, numDocs=2000
   [junit4]   2> 1655141 WARN  (cdcr-bootstrap-status-4155-thread-1) [    ] o.a.s.h.CdcrReplicatorManager Cancelling waiting for bootstrap on target: cdcr-target shard: shard1 to complete
   [junit4]   2> 1655145 WARN  (zkCallback-4140-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1655146 ERROR (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[EBF058479CCCE58A]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1665195 WARN  (Thread-4768) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/collections/cdcr-source/state.json
   [junit4]   2> 	4	/solr/collections/cdcr-source/cdcr/state/process
   [junit4]   2> 	3	/solr/collections/cdcr-source/cdcr/state/buffer
   [junit4]   2> 	2	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/live_nodes
   [junit4]   2> 	2	/solr/collections
   [junit4]   2> 
   [junit4]   2> 1665232 ERROR (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[EBF058479CCCE58A]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1670297 WARN  (Thread-4758) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/configs/cdcr-target/managed-schema
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	3	/solr/collections/cdcr-target/leaders/shard1/leader
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/collections/cdcr-target/state.json
   [junit4]   2> 	4	/solr/collections/cdcr-target/cdcr/state/process
   [junit4]   2> 	3	/solr/collections/cdcr-target/cdcr/state/buffer
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 
   [junit4]   2> 1670303 ERROR (Thread-4784) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1670411 ERROR (jetty-launcher-4156-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> Target zkHost = 127.0.0.1:42327/solr
   [junit4]   2> 1670633 ERROR (Thread-4794) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1670742 ERROR (jetty-launcher-4168-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> Adding 10 docs with commit=true, numDocs=100
   [junit4]   1> Adding 10 docs with commit=true, numDocs=200
   [junit4]   1> Adding 10 docs with commit=true, numDocs=300
   [junit4]   1> Adding 10 docs with commit=true, numDocs=400
   [junit4]   1> Adding 10 docs with commit=true, numDocs=500
   [junit4]   1> Adding 10 docs with commit=true, numDocs=600
   [junit4]   1> Adding 10 docs with commit=true, numDocs=700
   [junit4]   1> Adding 10 docs with commit=true, numDocs=800
   [junit4]   1> Adding 10 docs with commit=true, numDocs=900
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1000
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1100
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1200
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1300
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1400
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1500
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1600
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1700
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1800
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1900
   [junit4]   1> Adding 10 docs with commit=true, numDocs=2000
   [junit4]   1> Cdcr queue response: {responseHeader={status=0,QTime=0},queues={127.0.0.1:42327/solr={cdcr-target={queueSize=2009,lastTimestamp=}}},tlogTotalSize=96517,tlogTotalCount=21,updateLogSynchronizer=stopped}
   [junit4]   2> 1802405 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e149d208b0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1803907 WARN  (zkCallback-4175-thread-4) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1803907 ERROR (TEST-CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster-seed#[EBF058479CCCE58A]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1813990 WARN  (Thread-4794) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/aliases.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/collections/cdcr-source/state.json
   [junit4]   2> 	2	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/collections/cdcr-source/cdcr/state/process
   [junit4]   2> 	2	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	2	/solr/live_nodes
   [junit4]   2> 	2	/solr/collections
   [junit4]   2> 
   [junit4]   2> 1814012 ERROR (TEST-CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster-seed#[EBF058479CCCE58A]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1819061 WARN  (Thread-4784) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	2	/solr/configs/cdcr-target/managed-schema
   [junit4]   2> 	2	/solr/collections/cdcr-target/leaders/shard1/leader
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/collections/cdcr-target/state.json
   [junit4]   2> 	3	/solr/collections/cdcr-target/cdcr/state/process
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/collections/cdcr-target/cdcr/state/buffer
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=CdcrBootstrapTest -Dtests.method=testBootstrapWithContinousIndexingOnSourceCluster -Dtests.seed=EBF058479CCCE58A -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=lb -Dtests.timezone=America/Scoresbysund -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE  149s J0 | CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Document mismatch on target after sync expected:<2000> but was:<1990>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([EBF058479CCCE58A:3FB5131E7B9A5671]:0)
   [junit4]    > 	at org.apache.solr.cloud.CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster(CdcrBootstrapTest.java:309)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1819075 ERROR (Thread-4809) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1819180 ERROR (jetty-launcher-4190-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> Target zkHost = 127.0.0.1:35777/solr
   [junit4]   2> 1819316 ERROR (Thread-4819) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1819420 ERROR (jetty-launcher-4202-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> Adding 10 docs with commit=true, numDocs=100
   [junit4]   1> Adding 10 docs with commit=true, numDocs=200
   [junit4]   1> Adding 10 docs with commit=true, numDocs=300
   [junit4]   1> Adding 10 docs with commit=true, numDocs=400
   [junit4]   1> Adding 10 docs with commit=true, numDocs=500
   [junit4]   1> Adding 10 docs with commit=true, numDocs=600
   [junit4]   1> Adding 10 docs with commit=true, numDocs=700
   [junit4]   1> Adding 10 docs with commit=true, numDocs=800
   [junit4]   1> Adding 10 docs with commit=true, numDocs=900
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1000
   [junit4]   2> 1825802 WARN  (zkCallback-4209-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1825804 ERROR (TEST-CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap-seed#[EBF058479CCCE58A]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> -
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   2> 1827429 ERROR (TEST-CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap-seed#[EBF058479CCCE58A]) [    ] o.a.s.c.s.i.CloudSolrClient Request to collection cdcr-source failed due to (510) org.apache.solr.common.SolrException: Could not find a healthy node to handle the request., retry? 0
   [junit4]   2> 1827429 WARN  (TEST-CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap-seed#[EBF058479CCCE58A]) [    ] o.a.s.c.s.i.CloudSolrClient Re-trying request to  collection(s) cdcr-source after stale state error from server.
   [junit4]   1> Cdcr queue response: {responseHeader={status=0,QTime=0},queues={127.0.0.1:35777/solr={cdcr-target={queueSize=-2049966069,lastTimestamp=}}},tlogTotalSize=4773,tlogTotalCount=1,updateLogSynchronizer=stopped}
   [junit4]   2> 1832994 WARN  (cdcr-bootstrap-status-4228-thread-1) [    ] o.a.s.h.CdcrReplicatorManager Cancelling waiting for bootstrap on target: cdcr-target shard: shard1 to complete
   [junit4]   2> 1832997 WARN  (zkCallback-4222-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1832997 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e149f66a0000b, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 1832998 ERROR (TEST-CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap-seed#[EBF058479CCCE58A]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1836857 WARN  (Thread-4819) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	2	/solr/configs/cdcr-source
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	11	/solr/collections/cdcr-source/state.json
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/collections/cdcr-source/cdcr/state/process
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 	2	/solr/overseer/queue
   [junit4]   2> 	2	/solr/live_nodes
   [junit4]   2> 	2	/solr/overseer/collection-queue-work
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 
   [junit4]   2> 1838405 WARN  (zkCallback-4197-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1838406 ERROR (TEST-CdcrBootstrapTest.testConvertClusterToCdcrAndBootstrap-seed#[EBF058479CCCE58A]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1842643 WARN  (Thread-4809) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	2	/solr/configs/cdcr-target/managed-schema
   [junit4]   2> 	2	/solr/collections/cdcr-target/leaders/shard1/leader
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/collections/cdcr-target/state.json
   [junit4]   2> 	3	/solr/collections/cdcr-target/cdcr/state/process
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/collections/cdcr-target/cdcr/state/buffer
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.cloud.CdcrBootstrapTest_EBF058479CCCE58A-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {xyz=FST50, id=PostingsFormat(name=Direct)}, docValues:{_version_=DocValuesFormat(name=Lucene70), xyz=DocValuesFormat(name=Lucene70), id=DocValuesFormat(name=Direct)}, maxPointsInLeafNode=281, maxMBSortInHeap=7.036679133988004, sim=RandomSimilarity(queryNorm=true): {}, locale=lb, timezone=America/Scoresbysund
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 9 (32-bit)/cpus=8,threads=1,free=221266008,total=456613888
   [junit4]   2> NOTE: All tests run in this JVM: [SolrIndexSplitterTest, JvmMetricsTest, TestLMDirichletSimilarityFactory, TestReplicaProperties, TestStressUserVersions, DistributedDebugComponentTest, TestExtendedDismaxParser, UninvertDocValuesMergePolicyTest, HdfsNNFailoverTest, TestRuleBasedAuthorizationPlugin, TestBinaryField, TestNRTOpen, TestSimpleQParserPlugin, UpdateLogTest, SSLMigrationTest, SolrCLIZkUtilsTest, DistribJoinFromCollectionTest, SharedFSAutoReplicaFailoverTest, ChangedSchemaMergeTest, TestMacros, OverseerCollectionConfigSetProcessorTest, TestWriterPerf, TestCloudRecovery, AsyncCallRequestStatusResponseTest, ZkStateWriterTest, SolrGangliaReporterTest, SolrPluginUtilsTest, TestPayloadCheckQParserPlugin, MetricsHandlerTest, DocExpirationUpdateProcessorFactoryTest, CachingDirectoryFactoryTest, TestConfigSetsAPIExclusivity, TestBinaryResponseWriter, TestNumericRangeQuery64, TestHdfsBackupRestoreCore, TestCrossCoreJoin, CdcrReplicationDistributedZkTest, TestBulkSchemaConcurrent, TestDistribIDF, LeaderFailureAfterFreshStartTest, HighlighterConfigTest, RAMDirectoryFactoryTest, CustomCollectionTest, RulesTest, TestLegacyField, TestSchemaManager, TestFieldCollectionResource, TestSSLRandomization, TestImpersonationWithHadoopAuth, TestGeoJSONResponseWriter, BJQParserTest, MoveReplicaHDFSUlogDirTest, TestDistributedStatsComponentCardinality, TestCollectionAPIs, TestReplicationHandler, LeaderElectionIntegrationTest, DocumentAnalysisRequestHandlerTest, TestLegacyFieldCache, TestBadConfig, TestSolr4Spatial, TestMinMaxOnMultiValuedField, MBeansHandlerTest, SyncSliceTest, HdfsTlogReplayBufferedWhileIndexingTest, TestJoin, CollectionsAPIAsyncDistributedZkTest, TestRangeQuery, QueryElevationComponentTest, TestAuthenticationFramework, TestNestedDocsSort, TestSubQueryTransformerCrossCore, SynonymTokenizerTest, OpenExchangeRatesOrgProviderTest, VMParamsZkACLAndCredentialsProvidersTest, WordBreakSolrSpellCheckerTest, TestStressLiveNodes, TestImplicitCoreProperties, InfixSuggestersTest, IndexBasedSpellCheckerTest, SolrShardReporterTest, CursorMarkTest, DistributedFacetPivotSmallTest, HttpPartitionTest, DistributedQueryElevationComponentTest, TestRandomDVFaceting, TestCollationField, QueryResultKeyTest, TestTolerantUpdateProcessorRandomCloud, CdcrUpdateLogTest, TestQuerySenderNoQuery, TestCollationFieldDocValues, TestLuceneMatchVersion, OutputWriterTest, TestPivotHelperCode, TestCopyFieldCollectionResource, UtilsToolTest, DirectoryFactoryTest, TestLegacyTerms, SuggesterWFSTTest, TestRestoreCore, TestPHPSerializedResponseWriter, SolrJmxReporterTest, BlockCacheTest, PreAnalyzedFieldManagedSchemaCloudTest, DocValuesMissingTest, TestEmbeddedSolrServerAdminHandler, MigrateRouteKeyTest, DistributedSpellCheckComponentTest, OverseerStatusTest, SpellCheckCollatorWithCollapseTest, StressHdfsTest, TestGraphTermsQParserPlugin, DefaultValueUpdateProcessorTest, TestDistributedSearch, XmlUpdateRequestHandlerTest, BasicZkTest, AliasIntegrationTest, SpellCheckCollatorTest, HighlighterMaxOffsetTest, BasicDistributedZk2Test, UnloadDistributedZkTest, ShardRoutingTest, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, TestZkChroot, AutoCommitTest, TestFaceting, TestRecovery, ZkControllerTest, TestRealTimeGet, HardAutoCommitTest, DistributedTermsComponentTest, TestCoreContainer, SimpleFacetsTest, SolrCoreTest, TestGroupingSearch, SolrCmdDistributorTest, PeerSyncTest, BadIndexSchemaTest, TestFiltering, TestFunctionQuery, BasicFunctionalityTest, TestLazyCores, DirectUpdateHandlerTest, TestIndexSearcher, HighlighterTest, SoftAutoCommitTest, TestLFUCache, PreAnalyzedFieldTest, TestSystemIdResolver, TestSuggestSpellingConverter, SpellingQueryConverterTest, DOMUtilTest, ClusterStateTest, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, DistributedMLTComponentTest, CursorPagingTest, SolrTestCaseJ4Test, TestDistributedMissingSort, TestHighlightDedupGrouping, TestSimpleTrackingShardHandler, TestTolerantSearch, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, ConnectionReuseTest, ActionThrottleTest, AssignBackwardCompatibilityTest, BaseCdcrDistributedZkTest, CdcrBootstrapTest]
   [junit4] Completed [516/732 (2!)] on J0 in 203.33s, 3 tests, 1 failure <<< FAILURES!

[...truncated 37213 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20366 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20366/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.cloud.TestPullReplica.testKillLeader

Error Message:
Replica state not updated in cluster state null Live Nodes: [127.0.0.1:46677_solr, 127.0.0.1:33995_solr] Last available state: DocCollection(pull_replica_test_kill_leader//collections/pull_replica_test_kill_leader/state.json/6)={   "pullReplicas":"1",   "replicationFactor":"1",   "shards":{"shard1":{       "range":"80000000-7fffffff",       "state":"active",       "replicas":{         "core_node3":{           "core":"pull_replica_test_kill_leader_shard1_replica_n1",           "base_url":"https://127.0.0.1:33995/solr",           "node_name":"127.0.0.1:33995_solr",           "state":"down",           "type":"NRT",           "leader":"true"},         "core_node4":{           "core":"pull_replica_test_kill_leader_shard1_replica_p2",           "base_url":"https://127.0.0.1:46677/solr",           "node_name":"127.0.0.1:46677_solr",           "state":"active",           "type":"PULL"}}}},   "router":{"name":"compositeId"},   "maxShardsPerNode":"100",   "autoAddReplicas":"false",   "nrtReplicas":"1",   "tlogReplicas":"0"}

Stack Trace:
java.lang.AssertionError: Replica state not updated in cluster state
null
Live Nodes: [127.0.0.1:46677_solr, 127.0.0.1:33995_solr]
Last available state: DocCollection(pull_replica_test_kill_leader//collections/pull_replica_test_kill_leader/state.json/6)={
  "pullReplicas":"1",
  "replicationFactor":"1",
  "shards":{"shard1":{
      "range":"80000000-7fffffff",
      "state":"active",
      "replicas":{
        "core_node3":{
          "core":"pull_replica_test_kill_leader_shard1_replica_n1",
          "base_url":"https://127.0.0.1:33995/solr",
          "node_name":"127.0.0.1:33995_solr",
          "state":"down",
          "type":"NRT",
          "leader":"true"},
        "core_node4":{
          "core":"pull_replica_test_kill_leader_shard1_replica_p2",
          "base_url":"https://127.0.0.1:46677/solr",
          "node_name":"127.0.0.1:46677_solr",
          "state":"active",
          "type":"PULL"}}}},
  "router":{"name":"compositeId"},
  "maxShardsPerNode":"100",
  "autoAddReplicas":"false",
  "nrtReplicas":"1",
  "tlogReplicas":"0"}
	at __randomizedtesting.SeedInfo.seed([E658B7954186D0F6:AF4E4321233D44A0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
	at org.apache.solr.cloud.TestPullReplica.doTestNoLeader(TestPullReplica.java:401)
	at org.apache.solr.cloud.TestPullReplica.testKillLeader(TestPullReplica.java:290)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
No 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: No 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([E658B7954186D0F6:B9BC9AA22A8A43B3]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:85)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11294 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestPullReplica
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_E658B7954186D0F6-001/init-core-data-001
   [junit4]   2> 424878 WARN  (SUITE-TestPullReplica-seed#[E658B7954186D0F6]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=56 numCloses=56
   [junit4]   2> 424883 ERROR (Thread-1330) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 425018 ERROR (jetty-launcher-2002-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 425018 ERROR (jetty-launcher-2002-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 430086 WARN  (zkCallback-2014-thread-2-processing-n:127.0.0.1:33995_solr) [n:127.0.0.1:33995_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 430086 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e1341edce0006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 430121 ERROR (TEST-TestPullReplica.testKillPullReplica-seed#[E658B7954186D0F6]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 440631 ERROR (TEST-TestPullReplica.testRemoveAllWriterReplicas-seed#[E658B7954186D0F6]) [    ] o.a.s.c.s.i.CloudSolrClient Request to collection pull_replica_test_remove_all_writer_replicas failed due to (503) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:33995/solr/pull_replica_test_remove_all_writer_replicas: No registered leader was found after waiting for 4000ms , collection: pull_replica_test_remove_all_writer_replicas slice: shard1, retry? 0
   [junit4]   2> 444641 ERROR (TEST-TestPullReplica.testRemoveAllWriterReplicas-seed#[E658B7954186D0F6]) [    ] o.a.s.c.s.i.CloudSolrClient Request to collection pull_replica_test_remove_all_writer_replicas failed due to (503) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:33995/solr/pull_replica_test_remove_all_writer_replicas: No registered leader was found after waiting for 4000ms , collection: pull_replica_test_remove_all_writer_replicas slice: shard1, retry? 0
   [junit4]   2> 453666 WARN  (OverseerThreadFactory-1280-thread-5-processing-n:127.0.0.1:46677_solr) [n:127.0.0.1:46677_solr    ] o.a.s.c.CreateCollectionCmd Specified number of replicas of 4 on collection pull_replica_test_create_delete is higher than the number of Solr instances currently live or live and part of your createNodeSet(2). It's unusual to run two replica of the same slice on the same Solr-instance.
   [junit4]   1> / (11)
   [junit4]   1>  /configs (2)
   [junit4]   1>   /configs/_default (7)
   [junit4]   1>   DATA:
   [junit4]   1>       <?xml version="1.0" encoding="UTF-8" ?>
   [junit4]   1>       <!--
   [junit4]   1>        Licensed to the Apache Software Foundation (ASF) under one or more
   [junit4]   1>        contributor license agreements.  See the NOTICE file distributed with
   [junit4]   1>        this work for additional information regarding copyright ownership.
   [junit4]   1>        The ASF licenses this file to You under the Apache License, Version 2.0
   [junit4]   1>        (the "License"); you may not use this file except in compliance with
   [junit4]   1>        the License.  You may obtain a copy of the License at
   [junit4]   1>       
   [junit4]   1>            http://www.apache.org/licenses/LICENSE-2.0
   [junit4]   1>       
   [junit4]   1>        Unless required by applicable law or agreed to in writing, software
   [junit4]   1>        distributed under the License is distributed on an "AS IS" BASIS,
   [junit4]   1>        WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
   [junit4]   1>        See the License for the specific language governing permissions and
   [junit4]   1>        limitations under the License.
   [junit4]   1>       -->
   [junit4]   1>       
   [junit4]   1>       <!--
   [junit4]   1>            For more details about configurations options that may appear in
   [junit4]   1>            this file, see http://wiki.apache.org/solr/SolrConfigXml.
   [junit4]   1>       -->
   [junit4]   1>       <config>
   [junit4]   1>         <!-- In all configuration below, a prefix of "solr." for class names
   [junit4]   1>              is an alias that causes solr to search appropriate packages,
   [junit4]   1>              including org.apache.solr.(search|update|request|core|analysis)
   [junit4]   1>       
   [junit4]   1>              You may also specify a fully qualified Java classname if you
   [junit4]   1>              have your own custom plugins.
   [junit4]   1>           -->
   [junit4]   1>       
   [junit4]   1>         <!-- Controls what version of Lucene various components of Solr
   [junit4]   1>              adhere to.  Generally, you want to use the latest version to
   [junit4]   1>              get all bug fixes and improvements. It is highly recommended
   [junit4]   1>              that you fully re-index after changing this setting as it can
   [junit4]   1>              affect both how text is indexed and queried.
   [junit4]   1>         -->
   [junit4]   1>         <luceneMatchVersion>8.0.0</luceneMatchVersion>
   [junit4]   1>       
   [junit4]   1>         <!-- <lib/> directives can be used to instruct Solr to load any Jars
   [junit4]   1>              identified and use them to resolve any "plugins" specified in
   [junit4]   1>              your solrconfig.xml or schema.xml (ie: Analyzers, Request
   [junit4]   1>              Handlers, etc...).
   [junit4]   1>       
   [junit4]   1>              All directories and paths are resolved relative to the
   [junit4]   1>              instanceDir.
   [junit4]   1>       
   [junit4]   1>              Please note that <lib/> directives are processed in the order
   [junit4]   1>              that they appear in your solrconfig.xml file, and are "stacked"
   [junit4]   1>              on top of each other when building a ClassLoader - so if you have
   [junit4]   1>              plugin jars with dependencies on other jars, the "lower level"
   [junit4]   1>              dependency jars should be loaded first.
   [junit4]   1>       
   [junit4]   1>              If a "./lib" directory exists in your instanceDir, all files
   [junit4]   1>              found in it are included as if you had used the following
   [junit4]   1>              syntax...
   [junit4]   1>       
   [junit4]   1>                     <lib dir="./lib" />
   [junit4]   1>           -->
   [junit4]   1>       
   [junit4]   1>         <!-- A 'dir' option by itself adds any files found in the directory
   [junit4]   1>              to the classpath, this is useful for including all jars in a
   [junit4]   1>              directory.
   [junit4]   1>       
   [junit4]   1>              When a 'regex' is specified in addition to a 'dir', only the
   [junit4]   1>              files in that directory which completely match the regex
   [junit4]   1>              (anchored on both ends) will be included.
   [junit4]   1>       
   [junit4]   1>              If a 'dir' option (with or without a regex) is used and nothing
   [junit4]   1>              is found that matches, a warning will be logged.
   [junit4]   1>       
   [junit4]   1>              The examples below can be used to load some solr-contribs along
   [junit4]   1>              with their external dependencies.
   [junit4]   1>           -->
   [junit4]   1>         <lib dir="${solr.install.dir:../../../..}/contrib/extraction/lib" regex=".*\.jar" />
   [junit4]   1>         <lib dir="${solr.install.dir:../../../..}/dist/" regex="solr-cell-\d.*\.jar" />
   [junit4]   1>       
   [junit4]   1>         <lib dir="${solr.install.dir:../../../..}/contrib/clustering/lib/" regex=".*\.jar" />
   [junit4]   1>         <lib dir="${solr.install.dir:../../../..}/dist/" regex="solr-clustering-\d.*\.jar" />
   [junit4]   1>       
   [junit4]   1>         <lib dir="${solr.install.dir:../../../..}/contrib/langid/lib/" regex=".*\.jar" />
   [junit4]   1>         <lib dir="${solr.install.dir:../../../..}/dist/" regex="solr-langid-\d.*\.jar" />
   [junit4]   1>       
   [junit4]   1>         <lib dir="${solr.install.dir:../../../..}/contrib/velocity/lib" regex=".*\.jar" />
   [junit4]   1>         <lib dir="${solr.install.dir:../../../..}/dist/" regex="solr-velocity-\d.*\.jar" />
   [junit4]   1>         <!-- an exact 'path' can be used instead of a 'dir' to specify a
   [junit4]   1>              specific jar file.  This will cause a serious error to be logged
   [junit4]   1>              if it can't be loaded.
   [junit4]   1>           -->
   [junit4]   1>         <!--
   [junit4]   1>            <lib path="../a-jar-that-does-not-exist.jar" />
   [junit4]   1>         -->
   [junit4]   1>       
   [junit4]   1>         <!-- Data Directory
   [junit4]   1>       
   [junit4]   1>              Used to specify an alternate directory to hold all index data
   [junit4]   1>              other than the default ./data under the Solr home.  If
   [junit4]   1>              replication is in use, this should match the replication
   [junit4]   1>              configuration.
   [junit4]   1>           -->
   [junit4]   1>         <dataDir>${solr.data.dir:}</dataDir>
   [junit4]   1>       
   [junit4]   1>       
   [junit4]   1>         <!-- The DirectoryFactory to use for indexes.
   [junit4]   1>       
   [junit4]   1>              solr.StandardDirectoryFactory is filesystem
   [junit4]   1>              based and tries to pick the best implementation for the current
   [junit4]   1>              JVM and platform.  solr.NRTCachingDirectoryFactory, the default,
   [junit4]   1>              wraps solr.StandardDirectoryFactory and caches small files in memory
   [junit4]   1>              for better NRT performance.
   [junit4]   1>       
   [junit4]   1>              One can force a particular implementation via solr.MMapDirectoryFactory,
   [junit4]   1>              solr.NIOFSDirectoryFactory, or solr.SimpleFSDirectoryFactory.
   [junit4]   1>       
   [junit4]   1>              solr.RAMDirectoryFactory is memory based and not persistent.
   [junit4]   1>           -->
   [junit4]   1>         <directoryFactory name="DirectoryFactory"
   [junit4]   1>                           class="${solr.directoryFactory:solr.NRTCachingDirectoryFactory}"/>
   [junit4]   1>       
   [junit4]   1>         <!-- The CodecFactory for defining the format of the inverted index.
   [junit4]   1>              The default implementation is SchemaCodecFactory, which is the official Lucene
   [junit4]   1>              index format, but hooks into the schema to provide per-field customization of
   [junit4]   1>              the postings lists and per-document values in the fieldType element
   [junit4]   1>              (postingsFormat/docValuesFormat). Note that most of the alternative implementations
   [junit4]   1>              are experimental, so if you choose to customize the index format, it's a good
   [junit4]   1>              idea to convert back to the official format e.g. via IndexWriter.addIndexes(IndexReader)
   [junit4]   1>              before upgrading to a newer version to avoid unnecessary reindexing.
   [junit4]   1>              A "compressionMode" string element can be added to <codecFactory> to choose
   [junit4]   1>              between the existing compression modes in the default codec: "BEST_SPEED" (default)
   [junit4]   1>              or "BEST_COMPRESSION".
   [junit4]   1>         -->
   [junit4]   1>         <codecFactory class="solr.SchemaCodecFactory"/>
   [junit4]   1>       
   [junit4]   1>         <!-- ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   [junit4]   1>              Index Config - These settings control low-level behavior of indexing
   [junit4]   1>              Most example settings here show the default value, but are commented
   [junit4]   1>              out, to more easily see where customizations have been made.
   [junit4]   1>       
   [junit4]   1>              Note: This replaces <indexDefaults> and <mainIndex> from older versions
   [junit4]   1>              ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -->
   [junit4]   1>         <indexConfig>
   [junit4]   1>           <!-- maxFieldLength was removed in 4.0. To get similar behavior, include a
   [junit4]   1>                LimitTokenCountFilterFactory in your fieldType definition. E.g.
   [junit4]   1>            <filter class="solr.LimitTokenCountFilterFactory" maxTokenCount="10000"/>
   [junit4]   1>           -->
   [junit4]   1>           <!-- Maximum time to wait for a write lock (ms) for an IndexWriter. Default: 1000 -->
   [junit4]   1>           <!-- <writeLockTimeout>1000</writeLockTimeout>  -->
   [junit4]   1>       
   [junit4]   1>           <!-- Expert: Enabling compound file will use less files for the index,
   [junit4]   1>                using fewer file descriptors on the expense of performance decrease.
   [junit4]   1>                Default in Lucene is "true". Default in Solr is "false" (since 3.6) -->
   [junit4]   1>           <!-- <useCompoundFile>false</useCompoundFile> -->
   [junit4]   1>       
   [junit4]   1>           <!-- ramBufferSizeMB sets the amount of RAM that may be used by Lucene
   [junit4]   1>                indexing for buffering added documents and deletions before they are
   [junit4]   1>                flushed to the Directory.
   [junit4]   1>                maxBufferedDocs sets a limit on the number of documents buffered
   [junit4]   1>                before flushing.
   [junit4]   1>                If both ramBufferSizeMB and maxBufferedDocs is set, then
   [junit4]   1>                Lucene will flush based on whichever limit is hit first.  -->
   [junit4]   1>           <!-- <ramBufferSizeMB>100</ramBufferSizeMB> -->
   [junit4]   1>           <!-- <maxBufferedDocs>1000</maxBufferedDocs> -->
   [junit4]   1>       
   [junit4]   1>           <!-- Expert: Merge Policy
   [junit4]   1>                The Merge Policy in Lucene controls how merging of segments is done.
   [junit4]   1>                The default since Solr/Lucene 3.3 is TieredMergePolicy.
   [junit4]   1>                The default since Lucene 2.3 was the LogByteSizeMergePolicy,
   [junit4]   1>                Even older versions of Lucene used LogDocMergePolicy.
   [junit4]   1>             -->
   [junit4]   1>           <!--
   [junit4]   1>               <mergePolicyFactory class="org.apache.solr.index.TieredMergePolicyFactory">
   [junit4]   1>                 <int name="maxMergeAtOnce">10</int>
   [junit4]   1>                 <int name="segmentsPerTier">10</int>
   [junit4]   1>                 <double name="noCFSRatio">0.1</double>
   [junit4]   1>               </mergePolicyFactory>
   [junit4]   1>             -->
   [junit4]   1>       
   [junit4]   1>           <!-- Expert: Merge Scheduler
   [junit4]   1>                The Merge Scheduler in Lucene controls how merges are
   [junit4]   1>                performed.  The ConcurrentMergeScheduler (Lucene 2.3 default)
   [junit4]   1>                can perform merges in the background using separate threads.
   [junit4]   1>                The SerialMergeScheduler (Lucene 2.2 default) does not.
   [junit4]   1>            -->
   [junit4]   1>           <!--
   [junit4]   1>              <mergeScheduler class="org.apache.lucene.index.ConcurrentMergeScheduler"/>
   [junit4]   1>              -->
   [junit4]   1>       
   [junit4]   1>           <!-- LockFactory
   [junit4]   1>       
   [junit4]   1>                This option specifies which Lucene LockFactory implementation
   [junit4]   1>                to use.
   [junit4]   1>       
   [junit4]   1>                single = SingleInstanceLockFactory - suggested for a
   [junit4]   1>                         read-only index or when there is no possibility of
   [junit4]   1>                         another process trying to modify the index.
   [junit4]   1>                native = NativeFSLockFactory - uses OS native file locking.
   [junit4]   1>                         Do not use when multiple solr webapps in the same
   [junit4]   1>                         JVM are attempting to share a single index.
   [junit4]   1>                simple = SimpleFSLockFactory  - uses a plain file for locking
   [junit4]   1>       
   [junit4]   1>                Defaults: 'native' is default for Solr3.6 and later, otherwise
   [junit4]   1>                          'simple' is the default
   [junit4]   1>       
   [junit4]   1>                More details on the nuances of each LockFactory...
   [junit4]   1>                http://wiki.apache.org/lucene-java/AvailableLockFactories
   [junit4]   1>           -->
   [junit4]   1>           <lockType>${solr.lock.type:native}</lockType>
   [junit4]   1>       
   [junit4]   1>           <!-- Commit Deletion Policy
   [junit4]   1>                Custom deletion policies can be specified here. The class must
   [junit4]   1>                implement org.apache.lucene.index.IndexDeletionPolicy.
   [junit4]   1>       
   [junit4]   1>                The default Solr IndexDeletionPolicy implementation supports
   [junit4]   1>                deleting index commit points on number of commits, age of
   [junit4]   1>                commit point and optimized status.
   [junit4]   1>       
   [junit4]   1>                The latest commit point should always be preserved regardless
   [junit4]   1>                of the criteria.
   [junit4]   1>           -->
   [junit4]   1>           <!--
   [junit4]   1>           <deletionPolicy class="solr.SolrDeletionPolicy">
   [junit4]   1>           -->
   [junit4]   1>           <!-- The number of commit points to be kept -->
   [junit4]   1>           <!-- <str name="maxCommitsToKeep">1</str> -->
   [junit4]   1>           <!-- The number of optimized commit points to be kept -->
   [junit4]   1>           <!-- <str name="maxOptimizedCommitsToKeep">0</str> -->
   [junit4]   1>           <!--
   [junit4]   1>               Delete all commit points once they have reached the given age.
   [junit4]   1>               Supports DateMathParser syntax e.g.
   [junit4]   1>             -->
   [junit4]   1>           <!--
   [junit4]   1>              <str name="maxCommitAge">30MINUTES</str>
   [junit4]   1>              <str name="maxCommitAge">1DAY</str>
   [junit4]   1>           -->
   [junit4]   1>           <!--
   [junit4]   1>           </deletionPolicy>
   [junit4]   1>           -->
   [junit4]   1>       
   [junit4]   1>           <!-- Lucene Infostream
   [junit4]   1>       
   [junit4]   1>                To aid in advanced debugging, Lucene provides an "InfoStream"
   [junit4]   1>                of detailed information when indexing.
   [junit4]   1>       
   [junit4]   1>                Setting The value to true will instruct the underlying Lucene
   [junit4]   1>                IndexWriter to write its debugging info the specified file
   [junit4]   1>             -->
   [junit4]   1>           <!-- <infoStream file="INFOSTREAM.txt">false</infoStream> -->
   [junit4]   1>         </indexConfig>
   [junit4]   1>       
   [junit4]   1>       
   [junit4]   1>         <!-- JMX
   [junit4]   1>       
   [junit4]   1>              This example enables JMX if and only if an existing MBeanServer
   [junit4]   1>              is found, use this if you want to configure JMX through JVM
   [junit4]   1>              parameters. Remove this to disable exposing Solr configuration
   [junit4]   1>              and statistics to JMX.
   [junit4]   1>       
   [junit4]   1>              For more details see http://wiki.apache.org/solr/SolrJmx
   [junit4]   1>           -->
   [junit4]   1>         <jmx />
   [junit4]   1>         <!-- If you want to connect to a particular server, specify the
   [junit4]   1>              agentId
   [junit4]   1>           -->
   [junit4]   1>         <!-- <jmx agentId="myAgent" /> -->
   [junit4]   1>         <!-- If you want to start a new MBeanServer, specify the serviceUrl -->
   [junit4]   1>         <!-- <jmx serviceUrl="service:jmx:rmi:///jndi/rmi://localhost:9999/solr"/>
   [junit4]   1>           -->
   [junit4]   1>       
   [junit4]   1>         <!-- The default high-performance update handler -->
   [junit4]   1>         <updateHandler class="solr.DirectUpdateHandler2">
   [junit4]   1>       
   [junit4]   1>           <!-- Enables a transaction log, used for real-time get, durability, and
   [junit4]   1>                and solr cloud replica recovery.  The log can grow as big as
   [junit4]   1>                uncommitted changes to the index, so use of a hard autoCommit
   [junit4]   1>                is recommended (see below).
   [junit4]   1>                "dir" - the target directory for transaction logs, defaults to the
   [junit4]   1>                       solr data directory.
   [junit4]   1>                "numVersionBuckets" - sets the number of buckets used to keep
   [junit4]   1>                       track of max version values when checking for re-ordered
   [junit4]   1>                       updates; increase this value to reduce the cost of
   [junit4]   1>                       synchronizing access to version buckets during high-volume
   [junit4]   1>                       indexing, this requires 8 bytes (long) * numVersionBuckets
   [junit4]   1>                       of heap space per Solr core.
   [junit4]   1>           -->
   [junit4]   1>           <updateLog>
   [junit4]   1>             <str name="dir">${solr.ulog.dir:}</str>
   [junit4]   1>             <int name="numVersionBuckets">${solr.ulog.numVersionBuckets:65536}</int>
   [junit4]   1>           </updateLog>
   [junit4]   1>       
   [junit4]   1>           <!-- AutoCommit
   [junit4]   1>       
   [junit4]   1>                Perform a hard commit automatically under certain conditions.
   [junit4]   1>                Instead of enabling autoCommit, consider using "commitWithin"
   [junit4]   1>                when adding documents.
   [junit4]   1>       
   [junit4]   1>                http://wiki.apache.org/solr/UpdateXmlMessages
   [junit4]   1>       
   [junit4]   1>                maxDocs - Maximum number of documents to add since the last
   [junit4]   1>                          commit before automatically triggering a new commit.
   [junit4]   1>       
   [junit4]   1>                maxTime - Maximum amount of time in ms that is allowed to pass
   [junit4]   1>                          since a document was added before automatically
   [junit4]   1>                          triggering a new commit.
   [junit4]   1>                openSearcher - if false, the commit causes recent index changes
   [junit4]   1>                  to be flushed to stable storage, but does not cause a new
   [junit4]   1>                  searcher to be opened to make those changes visible.
   [junit4]   1>       
   [junit4]   1>                If the updateLog is enabled, then it's highly recommended to
   [junit4]   1>                have some sort of hard autoCommit to limit the log size.
   [junit4]   1>             -->
   [junit4]   1>           <autoCommit>
   [junit4]   1>             <maxTime>${solr.autoCommit.maxTime:15000}</maxTime>
   [junit4]   1>             <openSearcher>false</openSearcher>
   [junit4]   1>           </autoCommit>
   [junit4]   1>       
   [junit4]   1>           <!-- softAutoCommit is like autoCommit except it causes a
   [junit4]   1>                'soft' commit which only ensures that changes are visible
   [junit4]   1>                but does not ensure that data is synced to disk.  This is
   [junit4]   1>                faster and more near-realtime friendly than a hard commit.
   [junit4]   1>             -->
   [junit4]   1>       
   [junit4]   1>           <autoSoftCommit>
   [junit4]   1>             <maxTime>${solr.autoSoftCommit.maxTime:-1}</maxTime>
   [junit4]   1>           </autoSoftCommit>
   [junit4]   1>       
   [junit4]   1>           <!-- Update Related Event Listeners
   [junit4]   1>       
   [junit4]   1>                Various IndexWriter related events can trigger Listeners to
   [junit4]   1>                take actions.
   [junit4]   1>       
   [junit4]   1>                postCommit - fired after every commit or optimize command
   [junit4]   1>                postOptimize - fired after every optimize command
   [junit4]   1>             -->
   [junit4]   1>           <!-- The RunExecutableListener executes an external command from a
   [junit4]   1>                hook such as postCommit or postOptimize.
   [junit4]   1>       
   [junit4]   1>                exe - the name of the executable to run
   [junit4]   1>                dir - dir to use as the current working directory. (default=".")
   [junit4]   1>                wait - the calling thread waits until the executable returns.
   [junit4]   1>                       (default="true")
   [junit4]   1>                args - the arguments to pass to the program.  (default is none)
   [junit4]   1>                env - environment variables to set.  (default is none)
   [junit4]   1>             -->
   [junit4]   1>           <!-- This example shows how RunExecutableListener could be used
   [junit4]   1>                with the script based replication...
   [junit4]   1>                http://wiki.apache.org/solr/CollectionDistribution
   [junit4]   1>             -->
   [junit4]   1>           <!--
   [junit4]   1>              <listener event="postCommit" class="solr.RunExecutableListener">
   [junit4]   1>                <str name="exe">solr/bin/snapshooter</str>
   [junit4]   1>                <str name="dir">.</str>
   [junit4]   1>                <bool name="wait">true</bool>
   [junit4]   1>                <arr name="args"> <str>arg1</str> <str>arg2</str> </arr>
   [junit4]   1>                <arr name="env"> <str>MYVAR=val1</str> </arr>
   [junit4]   1>              </listener>
   [junit4]   1>             -->
   [junit4]   1>       
   [junit4]   1>         </updateHandler>
   [junit4]   1>       
   [junit4]   1>         <!-- IndexReaderFactory
   [junit4]   1>       
   [junit4]   1>              Use the following format to specify a custom IndexReaderFactory,
   [junit4]   1>              which allows for alternate IndexReader implementations.
   [junit4]   1>       
   [junit4]   1>              ** Experimental Feature **
   [junit4]   1>       
   [junit4]   1>              Please note - Using a custom IndexReaderFactory may prevent
   [junit4]   1>              certain other features from working. The API to
   [junit4]   1>              IndexReaderFactory may change without warning or may even be
   [junit4]   1>              removed from future releases if the problems cannot be
   [junit4]   1>              resolved.
   [junit4]   1>       
   [junit4]   1>       
   [junit4]   1>              ** Features that may not work with custom IndexReaderFactory **
   [junit4]   1>       
   [junit4]   1>              The ReplicationHandler assumes a disk-resident index. Using a
   [junit4]   1>              custom IndexReader implementation may cause incompatibility
   [junit4]   1>              with ReplicationHandler and may cause replication to not work
   [junit4]   1>              correctly. See SOLR-1366 for details.
   [junit4]   1>       
   [junit4]   1>           -->
   [junit4]   1>         <!--
   [junit4]   1>         <indexReaderFactory name="IndexReaderFactory" class="package.class">
   [junit4]   1>           <str name="someArg">Some Value</str>
   [junit4]   1>         </indexReaderFactory >
   [junit4]   1>         -->
   [junit4]   1>       
   [junit4]   1>         <!-- ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
   [junit4]   1>              Query section - these settings control query time things like caches
   [junit4]   1>              ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ -->
   [junit4]   1>         <query>
   [junit4]   1>       
   [junit4]   1>           <!-- Maximum number of clauses in each BooleanQuery,  an exception
   [junit4]   1>                is thrown if exceeded.  It is safe to increase or remove this setting,
   [junit4]   1>                since it is purely an arbitrary limit to try and catch user errors where
   [junit4]   1>                large boolean queries may not be the best implementation choice.
   [junit4]   1>             -->
   [junit4]   1>           <maxBooleanClauses>1024</maxBooleanClauses>
   [junit4]   1>       
   [junit4]   1>           <!-- Solr Internal Query Caches
   [junit4]   1>       
   [junit4]   1>                There are two implementations of cache available for Solr,
   [junit4]   1>                LRUCache, based on a synchronized LinkedHashMap, and
   [junit4]   1>                FastLRUCache, based on a ConcurrentHashMap.
   [junit4]   1>       
   [junit4]   1>                FastLRUCache has faster gets and slower puts in single
   [junit4]   1>                threaded operation and thus is generally faster than LRUCache
   [junit4]   1>                when the hit ratio of the cache is high (> 75%), and may be
   [junit4]   1>                faster under other scenarios on multi-cpu systems.
   [junit4]   1>           -->
   [junit4]   1>       
   [junit4]   1>           <!-- Filter Cache
   [junit4]   1>       
   [junit4]   1>                Cache used by SolrIndexSearcher for filters (DocSets),
   [junit4]   1>                unordered sets of *all* documents that match a query.  When a
   [junit4]   1>                new searcher is opened, its caches may be prepopulated or
   [junit4]   1>                "autowarmed" using data from caches in the old searcher.
   [junit4]   1>                autowarmCount is the number of items to prepopulate.  For
   [junit4]   1>                LRUCache, the autowarmed items will be the most recently
   [junit4]   1>                accessed items.
   [junit4]   1>       
   [junit4]   1>                Parameters:
   [junit4]   1>                  class - the SolrCache implementation LRUCache or
   [junit4]   1>                      (LRUCache or FastLRUCache)
   [junit4]   1>                  size - the maximum number of entries in the cache
   [junit4]   1>                  initialSize - the initial capacity (number of entries) of
   [junit4]   1>                      the cache.  (see java.util.HashMap)
   [junit4]   1>                  autowarmCount - the number of entries to prepopulate from
   [junit4]   1>                      and old cache.
   [junit4]   1>                  maxRamMB - the maximum amount of RAM (in MB) that this cache is allowed
   [junit4]   1>                             to occupy. Note that when this option is specified, the size
   [junit4]   1>                             and initialSize parameters are ignored.
   [junit4]   1>             -->
   [junit4]   1>           <filterCache class="solr.FastLRUCache"
   [junit4]   1>                        size="512"
   [junit4]   1>                        initialSize="512"
   [junit4]   1>                        autowarmCount="0"/>
   [junit4]   1>       
   [junit4]   1>           <!-- Query Result Cache
   [junit4]   1>       
   [junit4]   1>                Caches results of searches - ordered lists of document ids
   [junit4]   1>                (DocList) based on a query, a sort, and the range of documents requested.
   [junit4]   1>                Additional supported parameter by LRUCache:
   [junit4]   1>                   maxRamMB - the maximum amount of RAM (in MB) that this cache is allowed
   [junit4]   1>                              to occupy
   [junit4]   1>             -->
   [junit4]   1>           <queryResultCache class="solr.LRUCache"
   [junit4]   1>                             size="512"
   [junit4]   1>                             initialSize="512"
   [junit4]   1>                             autowarmCount="0"/>
   [junit4]   1>       
   [junit4]   1>           <!-- Document Cache
   [junit4]   1>       
   [junit4]   1>                Caches Lucene Document objects (the stored fields for each
   [junit4]   1>                document).  Since Lucene internal document ids are transient,
   [junit4]   1>                this cache will not be autowarmed.
   [junit4]   1>             -->
   [junit4]   1>           <documentCache class="solr.LRUCache"
   [junit4]   1>                          size="512"
   [junit4]   1>                          initialSize="512"
   [junit4]   1>                          autowarmCount="0"/>
   [junit4]   1>       
   [junit4]   1>           <!-- custom cache currently used by block join -->
   [junit4]   1>           <cache name="perSegFilter"
   [junit4]   1>                  class="solr.search.LRUCache"
   [junit4]   1>                  size="10"
   [junit4]   1>                  initialSize="0"
   [junit4]   1>                  autowarmCount="10"
   [junit4]   1>                  regenerator="solr.NoOpRegenerator" />
   [junit4]   1>       
   [junit4]   1>           <!-- Field Value Cache
   [junit4]   1>       
   [junit4]   1>                Cache used to hold field values that are quickly accessible
   [junit4]   1>                by document id.  The fieldValueCache is created by default
   [junit4]   1>                even if not configured here.
   [junit4]   1>             -->
   [junit4]   1>           <!--
   [junit4]   1>              <fieldValueCache class="solr.FastLRUCache"
   [junit4]   1>                               size="512"
   [junit4]   1>                               autowarmCount="128"
   [junit4]   1>                               showItems="32" />
   [junit4]   1>             -->
   [junit4]   1>       
   [junit4]   1>           <!-- Custom Cache
   [junit4]   1>       
   [junit4]   1>                Example of a generic cache.  These caches may be accessed by
   [junit4]   1>                name through SolrIndexSearcher.getCache(),cacheLookup(), and
   [junit4]   1>                cacheInsert().  The purpose is to enable easy caching of
   [junit4]   1>                user/application level data.  The regenerator argument should
   [junit4]   1>                be specified as an implementation of solr.CacheRegenerator
   [junit4]   1>                if autowarming is desired.
   [junit4]   1>             -->
   [junit4]   1>           <!--
   [junit4]   1>              <cache name="myUserCache"
   [junit4]   1>                     class="solr.LRUCache"
   [junit4]   1>                     size="4096"
   [junit4]   1>                     initialSize="1024"
   [junit4]   1>                     autowarmCount="1024"
   [junit4]   1>                     regenerator="com.mycompany.MyRegenerator"
   [junit4]   1>                     />
   [junit4]   1>             -->
   [junit4]   1>       
   [junit4]   1>       
   [junit4]   1>           <!-- Lazy Field Loading
   [junit4]   1>       
   [junit4]   1>                If true, stored fields that are not requested will be loaded
   [junit4]   1>                lazily.  This can result in a significant speed improvement
   [junit4]   1>                if the usual case is to not load all stored fields,
   [junit4]   1>                especially if the skipped fields are large compressed text
   [junit4]   1>                fields.
   [junit4]   1>           -->
   [junit4]   1>           <enableLazyFieldLoading>true</enableLazyFieldLoading>
   [junit4]   1>       
   [junit4]   1>           <!-- Use Filter For Sorted Query
   [junit4]   1>       
   [junit4]   1>                A possible optimization that attempts to use a filter to
   [junit4]   1>                satisfy a search.  If the requested sort does not include
   [junit4]   1>                score, then the filterCache will be checked for a filter
   [junit4]   1>                matching the query. If found, the filter will be used as the
   [junit4]   1>                source of document ids, and then the sort will be applied to
   [junit4]   1>                that.
   [junit4]   1>       
   [junit4]   1>                For most situations, this will not be useful unless you
   [junit4]   1>                frequently get the same search repeatedly with different sort
   [junit4]   1>                options, and none of them ever use "score"
   [junit4]   1>             -->
   [junit4]   1>           <!--
   [junit4]   1>              <useFilterForSortedQuery>true</useFilterForSortedQuery>
   [junit4]   1>             -->
   [junit4]   1>       
   [junit4]   1>           <!-- Result Window Size
   [junit4]   1>       
   [junit4]   1>                An optimization for use with the queryResultCache.  When a search
   [junit4]   1>                is requested, a superset of the requested number of document ids
   [junit4]   1>                are collected.  For example, if a search for a particular query
   [junit4]   1>                requests matching documents 10 through 19, and queryWindowSize is 50,
   [junit4]   1>                then documents 0 through 49 will be collected and cached.  Any further
   [junit4]   1>                requests in that range can be satisfied via the cache.
   [junit4]   1>             -->
   [junit4]   1>           <queryResultWindowSize>20</queryResultWindowSize>
   [junit4]   1>       
   [junit4]   1>           <!-- Maximum number of documents to cache for any entry in the
   [junit4]   1>                queryResultCache.
   [junit4]   1>             -->
   [junit4]   1>           <queryResultMaxDocsCached>200</queryResultMaxDocsCached>
   [junit4]   1>       
   [junit4]   1>           <!-- Query Related Event Listeners
   [junit4]   1>       
   [junit4]   1>                Various IndexSearcher related events can trigger Listeners to
   [junit4]   1>                take actions.
   [junit4]   1>       
   [junit4]   1>                newSearcher - fired whenever a new searcher is being prepared
   [junit4]   1>                and there is a current searcher handling requests (aka
   [junit4]   1>                registered).  It can be used to prime certain caches to
   [junit4]   1>                prevent long request times for certain requests.
   [junit4]   1>       
   [junit4]   1>                firstSearcher - fired whenever a new searcher is being
   [junit4]   1>                prepared but there is no current registered searcher to handle
   [junit4]   1>                requests or to gain autowarming data from.
   [junit4]   1>       
   [junit4]   1>       
   [junit4]   1>             -->
   [junit4]   1>           <!-- QuerySenderListener takes an array of NamedList and executes a
   [junit4]   1>                local query request for each NamedList in sequence.
   [junit4]   1>             -->
   [junit4]   1>           <listener event="newSearcher" class="solr.QuerySenderListener">
   [junit4]   1>             <arr name="queries">
   [junit4]   1>               <!--
   [junit4]   1>                  <lst><str name="q">solr</str><str name="sort">price asc</str></lst>
   [junit4]   1>                  <lst><str name="q">rocks</str><str name="sort">weight asc</str></lst>
   [junit4]   1>                 -->
   [junit4]   1>             </arr>
   [junit4]   1>           </listener>
   [junit4]   1>           <listener event="firstSearcher" class="solr.QuerySenderListener">
   [junit4]   1>             <arr name="queries">
   [junit4]   1>               <!--
   [junit4]   1>               <lst>
   [junit4]   1>                 <str name="q">static firstSearcher warming in solrconfig.xml</str>
   [junit4]   1>               </lst>
   [junit4]   1>               -->
   [junit4]   1>             </arr>
   [junit4]   1>           </listener>
   [junit4]   1>       
   [junit4]   1>           <!-- Use Cold Searcher
   [junit4]   1>       
   [junit4]   1>                If a search request comes in and there is no current
   [junit4]   1>                registered searcher, then immediately register the still
   [junit4]   1>                warming searcher and use it.  If "false" then all requests
   [junit4]   1>                will block until the first searcher is done warming.
   [junit4]   1>             -->
   [junit4]   1>           <useColdSearcher>false</useColdSearcher>
   [junit4]   1>       
   [junit4]   1>         </query>
   [junit4]   1>       
   [junit4]   1>       
   [junit4]   1>         <!-- Request Dispatcher
   [junit4]   1>       
   [junit4]   1>              This section contains instructions for how the SolrDispatchFilter
   [junit4]   1>              should behave when processing requests for this SolrCore.
   [junit4]   1>       
   [junit4]   1>           -->
   [junit4]   1>         <requestDispatcher>
   [junit4]   1>           <!-- Request Parsing
   [junit4]   1>       
   [junit4]   1>                These settings indicate how Solr Requests may be parsed, and
   [junit4]   1>                what restrictions may be placed on the ContentStreams from
   [junit4]   1>                those requests
   [junit4]   1>       
   [junit4]   1>                enableRemoteStreaming - enables use of the stream.file
   [junit4]   1>                and stream.url parameters for specifying remote streams.
   [junit4]   1>       
   [junit4]   1>                multipartUploadLimitInKB - specifies the max size (in KiB) of
   [junit4]   1>                Multipart File Uploads that Solr will allow in a Request.
   [junit4]   1>       
   [junit4]   1>                formdataUploadLimitInKB - specifies the max size (in KiB) of
   [junit4]   1>                form data (application/x-www-form-urlencoded) sent via
   [junit4]   1>                POST. You can use POST to pass request parameters not
   [junit4]   1>                fitting into the URL.
   [junit4]   1>       
   [junit4]   1>                addHttpRequestToContext - if set to true, it will instruct
   [junit4]   1>                the requestParsers to include the original HttpServletRequest
   [junit4]   1>                object in the context map of the SolrQueryRequest under the
   [junit4]   1>                key "httpRequest". It will not be used by any of the existing
   [junit4]   1>                Solr components, but may be useful when developing custom
   [junit4]   1>                plugins.
   [junit4]   1>       
   [junit4]   1>                *** WARNING ***
   [junit4]   1>                Before enabling remote streaming, you should make sure your
   [junit4]   1>                system has authentication enabled.
   [junit4]   1>       
   [junit4]   1>           <requestParsers enableRemoteStreaming="false"
   [junit4]   1>                           multipartUploadLimitInKB="-1"
   [junit4]   1>                           formdataUploadLimitInKB="-1"
   [junit4]   1>                           addHttpRequestToContext="false"/>
   [junit4]   1>             -->
   [junit4]   1>       
   [junit4]   1>           <!-- HTTP Caching
   [junit4]   1>       
   [junit4]   1>                Set HTTP caching related parameters (for proxy caches and clients).
   [junit4]   1>       
   [junit4]   1>                The options below instruct Solr not to output any HTTP Caching
   [junit4]   1>                related headers
   [junit4]   1>             -->
   [junit4]   1>           <httpCaching never304="true" />
   [junit4]   1>           <!-- If you include a <cacheControl> directive, it will be used to
   [junit4]   1>                generate a Cache-Control header (as well as an Expires header
   [junit4]   1>                if the value contains "max-age=")
   [junit4]   1>       
   [junit4]   1>                By default, no Cache-Control header is generated.
   [junit4]   1>       
   [junit4]   1>                You can use the <cacheControl> option even if you have set
   [junit4]   1>                never304="true"
   [junit4]   1>             -->
   [junit4]   1>           <!--
   [junit4]   1>              <httpCaching never304="true" >
   [junit4]   1>                <cacheControl>max-age=30, public</cacheControl>
   [junit4]   1>              </httpCaching>
   [junit4]   1>             -->
   [junit4]   1>           <!-- To enable Solr to respond with automatically generated HTTP
   [junit4]   1>                Caching headers, and to response to Cache Validation requests
   [junit4]   1>                correctly, set the value of never304="false"
   [junit4]   1>       
   [junit4]   1>                This will cause Solr to generate Last-Modified and ETag
   [junit4]   1>                headers based on the properties of the Index.
   [junit4]   1>       
   [junit4]   1>                The following options can also be specified to affect the
   [junit4]   1>                values of these headers...
   [junit4]   1>       
   [junit4]   1>                lastModFrom - the default value is "openTime" which means the
   [junit4]   1>                Last-Modified value (and validation against If-Modified-Since
   [junit4]   1>                requests) will all be relative to when the current Searcher
   [junit4]   1>                was opened.  You can change it to lastModFrom="dirLastMod" if
   [junit4]   1>                you want the value to exactly correspond to when the physical
   [junit4]   1>                index was last modified.
   [junit4]   1>       
   [junit4]   1>                etagSeed="..." is an option you can change to force the ETag
   [junit4]   1>                header (and validation against If-None-Match requests) to be
   [junit4]   1>                different even if the index has not changed (ie: when making
   [junit4]   1>                significant changes to your config file)
   [junit4]   1>       
   [junit4]   1>                (lastModifiedFrom and etagSeed are both ignored if you use
   [junit4]   1>                the never304="true" option)
   [junit4]   1>             -->
   [junit4]   1>           <!--
   [junit4]   1>              <httpCaching lastModifiedFrom="openTime"
   [junit4]   1>                           etagSeed="Solr">
   [junit4]   1>                <cacheControl>max-age=30, public</cacheControl>
   [junit4]   1>              </httpCaching>
   [junit4]   1>             -->
   [junit4]   1>         </requestDispatcher>
   [junit4]   1>       
   [junit4]   1>         <!-- Request Handlers
   [junit4]   1>       
   [junit4]   1>              http://wiki.apache.org/solr/SolrRequestHandler
   [junit4]   1>       
   [junit4]   1>              Incoming queries will be dispatched to a specific handler by name
   [junit4]   1>              based on the path specified in the request.
   [junit4]   1>       
   [junit4]   1>              If a Request Handler is declared with startup="lazy", then it will
   [junit4]   1>              not be initialized until the first request that uses it.
   [junit4]   1>       
   [junit4]   1>           -->
   [junit4]   1>         <!-- SearchHandler
   [junit4]   1>       
   [junit4]   1>              http://wiki.apache.org/solr/SearchHandler
   [junit4]   1>       
   [junit4]   1>              For processing Search Queries, the primary Request Handler
   [junit4]   1>              provided with Solr is "SearchHandler" It delegates to a sequent
   [junit4]   1>              of SearchComponents (see below) and supports distributed
   [junit4]   1>              queries across multiple shards
   [junit4]   1>           -->
   [junit4]   1>         <requestHandler name="/select" class="solr.SearchHandler">
   [junit4]   1>           <!-- default values for query parameters can be specified, these
   [junit4]   1>                will be overridden by parameters in the request
   [junit4]   1>             -->
   [junit4]   1>           <lst name="defaults">
   [junit4]   1>             <str name="echoParams">explicit</str>
   [junit4]   1>             <int name="rows">10</int>
   [junit4]   1>             <!-- Default search field
   [junit4]   1>                <str name="df">text</str> 
   [junit4]   1>               -->
   [junit4]   1>             <!-- Change from JSON to XML format (the default prior to Solr 7.0)
   [junit4]   1>                <str name="wt">xml</str> 
   [junit4]   1>               -->
   [junit4]   1>           </lst>
   [junit4]   1>           <!-- In addition to defaults, "appends" params can be specified
   [junit4]   1>                to identify values which should be appended to the list of
   [junit4]   1>                multi-val params from the query (or the existing "defaults").
   [junit4]   1>             -->
   [junit4]   1>           <!-- In this example, the param "fq=instock:true" would be appended to
   [junit4]   1>                any query time fq params the user may specify, as a mechanism for
   [junit4]   1>                partitioning the index, independent of any user selected filtering
   [junit4]   1>                that may also be desired (perhaps as a result of faceted searching).
   [junit4]   1>       
   [junit4]   1>                NOTE: there is *absolutely* nothing a client can do to prevent these
   [junit4]   1>                "appends" values from being used, so don't use this mechanism
   [junit4]   1>                unless you are sure you always want it.
   [junit4]   1>             -->
   [junit4]   1>           <!--
   [junit4]   1>              <lst name="appends">
   [junit4]   1>                <str name="fq">inStock:true</str>
   [junit4]   1>              </lst>
   [junit4]   1>             -->
   [junit4]   1>           <!-- "invariants" are a way of letting the Solr maintainer lock down
   [junit4]   1>                the options available to Solr clients.  Any params values
   [junit4]   1>                specified here are used regardless of what values may be specified
   [junit4]   1>                in either the query, the "defaults", or the "appends" params.
   [junit4]   1>       
   [junit4]   1>                In this example, the facet.field and facet.query params would
   [junit4]   1>                be fixed, limiting the facets clients can use.  Faceting is
   [junit4]   1>                not turned on by default - but if the client does specify
   [junit4]   1>                facet=true in the request, these are the only facets they
   [junit4]   1>                will be able to see counts for; regardless of what other
   [junit4]   1>                facet.field or facet.query params they may specify.
   [junit4]   1>       
   [junit4]   1>                NOTE: there is *absolutely* nothing a client can do to prevent these
   [junit4]   1>                "invariants" values from being used, so don't use this mechanism
   [junit4]   1>                unless you are sure you always want it.
   [junit4]   1>             -->
   [junit4]   1>           <!--
   [junit4]   1>              <lst name="invariants">
   [junit4]   1>                <str name="facet.field">cat</str>
   [junit4]   1>                <str name="facet.field">manu_exact</str>
   [junit4]   1>                <str name="facet.query">price:[* TO 500]</str>
   [junit4]   1>                <str name="facet.query">price:[500 TO *]</str>
   [junit4]   1>              </lst>
   [junit4]   1>             -->
   [junit4]   1>           <!-- If the default list of SearchComponents is not desired, that
   [junit4]   1>                list can either be overridden completely, or components can be
   [junit4]   1>                prepended or appended to the default list.  (see below)
   [junit4]   1>             -->
   [junit4]   1>           <!--
   [junit4]   1>              <arr name="components">
   [junit4]   1>                <str>nameOfCustomComponent1</str>
   [junit4]   1>                <str>nameOfCustomComponent2</str>
   [junit4]   1>              </arr>
   [junit4]   1>             -->
   [junit4]   1>         </requestHandler>
   [junit4]   1>       
   [junit4]   1>         <!-- A request handler that returns indented JSON by default -->
   [junit4]   1>         <requestHandler name="/query" class="solr.SearchHandler">
   [junit4]   1>           <lst name="defaults">
   [junit4]   1>             <str name="echoParams">explicit</str>
   [junit4]   1>             <str name="wt">json</str>
   [junit4]   1>             <str name="indent">true</str>
   [junit4]   1>           </lst>
   [junit4]   1>         </requestHandler>
   [junit4]   1>       
   [junit4]   1>       
   [junit4]   1>         <!-- A Robust Example
   [junit4]   1>       
   [junit4]   1>              This example SearchHandler declaration shows off usage of the
   [junit4]   1>              SearchHandler with many defaults declared
   [junit4]   1>       
   [junit4]   1>              Note that multiple instances of the same Request Handler
   [junit4]   1>              (SearchHandler) can be registered multiple times with different
   [junit4]   1>              names (and different init parameters)
   [junit4]   1>           -->
   [junit4]   1>         <requestHandler name="/browse" class="solr.SearchHandler" useParams="query,facets,velocity,browse">
   [junit4]   1>           <lst name="defaults">
   [junit4]   1>             <str name="echoParams">explicit</str>
   [junit4]   1>           </lst>
   [junit4]   1>         </requestHandler>
   [junit4]   1>       
   [junit4]   1>         <initParams path="/update/**,/query,/select,/tvrh,/elevate,/spell,/browse">
   [junit4]   1>           <lst name="defaults">
   [junit4]   1>             <str name="df">_text_</str>
   [junit4]   1>           </lst>
   [junit4]   1>         </initParams>
   [junit4]   1>       
   [junit4]   1>         <!-- Solr Cell Update Request Handler
   [junit4]   1>       
   [junit4]   1>              http://wiki.apache.org/solr/ExtractingRequestHandler
   [junit4]   1>       
   [junit4]   1>           -->
   [junit4]   1>         <requestHandler name="/update/extract"
   [junit4]   1>                         startup="lazy"
   [junit4]   1>                         class="solr.extraction.ExtractingRequestHandler" >
   [junit4]   1>           <lst name="defaults">
   [junit4]   1>             <str name="lowernames">true</str>
   [junit4]   1>             <str name="fmap.meta">ignored_</str>
   [junit4]   1>             <str name="fmap.content">_text_</str>
   [junit4]   1>           </lst>
   [junit4]   1>         </requestHandler>
   [junit4]   1>       
   [junit4]   1>         <!-- Search Components
   [junit4]   1>       
   [junit4]   1>              Search components are registered to SolrCore and used by
   [junit4]   1>              instances of SearchHandler (which can access them by name)
   [junit4]   1>       
   [junit4]   1>              By default, the following components are available:
   [junit4]   1>       
   [junit4]   1>              <searchComponent name="query"     class="solr.QueryComponent" />
   [junit4]   1>              <searchComponent name="facet"     class="solr.FacetComponent" />
   [junit4]   1>              <searchComponent name="mlt"       class="solr.MoreLikeThisComponent" />
   [junit4]   1>              <searchComponent name="highlight" class="solr.HighlightComponent" />
   [junit4]   1>              <searchComponent name="stats"     class="solr.StatsComponent" />
   [junit4]   1>              <searchComponent name="debug"     class="solr.DebugComponent" />
   [junit4]   1>       
   [junit4]   1>              Default configuration in a requestHandler would look like:
   [junit4]   1>       
   [junit4]   1>              <arr name="components">
   [junit4]   1>                <str>query</str>
   [junit4]   1>                <str>facet</str>
   [junit4]   1>                <str>mlt</str>
   [junit4]   1>                <str>highlight</str>
   [junit4]   1>                <str>stats</str>
   [junit4]   1>                <str>debug</str>
   [junit4]   1>              </arr>
   [junit4]   1>       
   [junit4]   1>              If you register a searchComponent to one of the standard names,
   [junit4]   1>              that will be used instead of the default.
   [junit4]   1>       
   [junit4]   1>              To insert components before or after the 'standard' components, use:
   [junit4]   1>       
   [junit4]   1>              <arr name="first-components">
   [junit4]   1>                <str>myFirstComponentName</str>
   [junit4]   1>              </arr>
   [junit4]   1>       
   [junit4]   1>              <arr name="last-components">
   [junit4]   1>                <str>myLastComponentName</str>
   [junit4]   1>              </arr>
   [junit4]   1>       
   [junit4]   1>              NOTE: The component registered with the name "debug" will
   [junit4]   1>              always be executed after the "last-components"
   [junit4]   1>       
   [junit4]   1>            -->
   [junit4]   1>       
   [junit4]   1>         <!-- Spell Check
   [junit4]   1>       
   [junit4]   1>              The spell check component can return a list of alternative spelling
   [junit4]   1>              suggestions.
   [junit4]   1>       
   [junit4]   1>              http://wiki.apache.org/solr/SpellCheckComponent
   [junit4]   1>           -->
   [junit4]   1>         <searchComponent name="spellcheck" class="solr.SpellCheckComponent">
   [junit4]   1>       
   [junit4]   1>           <str name="queryAnalyzerFieldType">text_general</str>
   [junit4]   1>       
   [junit4]   1>           <!-- Multiple "Spell Checkers" can be declared and used by this
   [junit4]   1>                component
   [junit4]   1>             -->
   [junit4]   1>       
   [junit4]   1>           <!-- a spellchecker built from a field of the main index -->
   [junit4]   1>           <lst name="spellchecker">
   [junit4]   1>             <str name="name">default</str>
   [junit4]   1>             <str name="field">_text_</str>
   [junit4]   1>             <str name="classname">solr.DirectSolrSpellChecker</str>
   [junit4]   1>             <!-- the spellcheck distance measure used, the default is the internal levenshtein -->
   [junit4]   1>             <str name="distanceMeasure">internal</str>
   [junit4]   1>             <!-- minimum accuracy needed to be considered a valid spellcheck suggestion -->
   [junit4]   1>             <float name="accuracy">0.5</float>
   [junit4]   1>             <!-- the maximum #edits we consider when enumerating terms: can be 1 or 2 -->
   [junit4]   1>             <int name="maxEdits">2</int>
   [junit4]   1>             <!-- the minimum shared prefix when enumerating terms -->
   [junit4]   1>             <int name="minPrefix">1</int>
   [junit4]   1>             <!-- maximum number of inspections per result. -->
   [junit4]   1>             <int name="maxInspections">5</int>
   [junit4]   1>             <!-- minimum length of a query term to be considered for correction -->
   [junit4]   1>             <int name="minQueryLength">4</int>
   [junit4]   1>             <!-- maximum threshold of documents a query term can appear to be considered for correction -->
   [junit4]   1>             <float name="maxQueryFrequency">0.01</float>
   [junit4]   1>             <!-- uncomment this to require suggestions to occur in 1% of the documents
   [junit4]   1>               <float name="thresholdTokenFrequency">.01</float>
   [junit4]   1>             -->
   [junit4]   1>           </lst>
   [junit4]   1>       
   [junit4]   1>           <!-- a spellchecker that can break or combine words.  See "/spell" handler below for usage -->
   [junit4]   1>           <!--
   [junit4]   1>           <lst name="spellchecker">
   [junit4]   1>             <str name="name">wordbreak</str>
   [junit4]   1>             <str name="classname">solr.WordBreakSolrSpellChecker</str>
   [junit4]   1>             <str name="field">name</str>
   [junit4]   1>             <str name="combineWords">true</str>
   [junit4]   1>             <str name="breakWords">true</str>
   [junit4]   1>             <int name="maxChanges">10</int>
   [junit4]   1>           </lst>
   [junit4]   1>           -->
   [junit4]   1>         </searchComponent>
   [junit4]   1>       
   [junit4]   1>         <!-- A request handler for demonstrating the spellcheck component.
   [junit4]   1>       
   [junit4]   1>              NOTE: This is purely as an example.  The whole purpose of the
   [junit4]   1>              SpellCheckComponent is to hook it into the request handler that
   [junit4]   1>              handles your normal user queries so that a separate request is
   [junit4]   1>              not needed to get suggestions.
   [junit4]   1>       
   [junit4]   1>              IN OTHER WORDS, THERE IS REALLY GOOD CHANCE THE SETUP BELOW IS
   [junit4]   1>              NOT WHAT YOU WANT FOR YOUR PRODUCTION SYSTEM!
   [junit4]   1>       
   [junit4]   1>              See http://wiki.apache.org/solr/SpellCheckComponent for details
   [junit4]   1>              on the request parameters.
   [junit4]   1>           -->
   [junit4]   1>         <requestHandler name="/spell" class="solr.SearchHandler" startup="lazy">
   [junit4]   1>           <lst name="defaults">
   [junit4]   1>             <!-- Solr will use suggestions from both the 'default' spellchecker
   [junit4]   1>                  and from the 'wordbreak' spellchecker and combine them.
   [junit4]   1>                  collations (re-written queries) can include a combination of
   [junit4]   1>                  corrections from both spellcheckers -->
   [junit4]   1>             <str name="spellcheck.dictionary">default</str>
   [junit4]   1>             <str name="spellcheck">on</str>
   [junit4]   1>             <str name="spellcheck.extendedResults">true</str>
   [junit4]   1>             <str name="spellcheck.count">10</str>
   [junit4]   1>             <str name="spellcheck.alternativeTermCount">5</str>
   [junit4]   1>             <str name="spellcheck.maxResultsForSuggest">5</str>
   [junit4]   1>             <str name="spellcheck.collate">true</str>
   [junit4]   1>             <str name="spellcheck.collateExtendedResults">true</str>
   [junit4]   1>             <str name="spellcheck.maxCollationTries">10</str>
   [junit4]   1>             <str name="spellcheck.maxCollations">5</str>
   [junit4]   1>           </lst>
   [junit4]   1>           <arr name="last-components">
   [junit4]   1>             <str>spellcheck</str>
   [junit4]   1>           </arr>
   [junit4]   1>         </requestHandler>
   [junit4]   1>       
   [junit4]   1>         <!-- Term Vector Component
   [junit4]   1>       
   [junit4]   1>              http://wiki.apache.org/solr/TermVectorComponent
   [junit4]   1>           -->
   [junit4]   1>         <searchComponent name="tvComponent" class="solr.TermVectorComponent"/>
   [junit4]   1>       
   [junit4]   1>         <!-- A request handler for demonstrating the term vector component
   [junit4]   1>       
   [junit4]   1>              This is purely as an example.
   [junit4]   1>       
   [junit4]   1>              In reality you will likely want to add the component to your
   [junit4]   1>              already specified request handlers.
   [junit4]   1>           -->
   [junit4]   1>         <requestHandler name="/tvrh" class="solr.SearchHandler" startup="lazy">
   [junit4]   1>           <lst name="defaults">
   [junit4]   1>             <bool name="tv">true</bool>
   [junit4]   1>           </lst>
   [junit4]   1>           <arr name="last-components">
   [junit4]   1>             <str>tvComponent</str>
   [junit4]   1>           </arr>
   [junit4]   1>         </requestHandler>
   [junit4]   1>       
   [junit4]   1>         <!-- Clustering Component. (Omitted here. See the default Solr example for a typical configuration.) -->
   [junit4]   1>       
   [junit4]   1>         <!-- Terms Component
   [junit4]   1>       
   [junit4]   1>              http://wiki.apache.org/solr/TermsComponent
   [junit4]   1>       
   [junit4]   1>              A component to return terms and document frequency of those
   [junit4]   1>              terms
   [junit4]   1>           -->
   [junit4]   1>         <searchComponent name="terms" class="solr.TermsComponent"/>
   [junit4]   1>       
   [junit4]   1>         <!-- A request handler for demonstrating the terms component -->
   [junit4]   1>         <requestHandler name="/terms" class="solr.SearchHandler" startup="lazy">
   [junit4]   1>           <lst name="defaults">
   [junit4]   1>             <bool name="terms">true</bool>
   [junit4]   1>             <bool name="distrib">false</bool>
   [junit4]   1>           </lst>
   [junit4]   1>           <arr name="components">
   [junit4]   1>             <str>terms</str>
   [junit4]   1>           </arr>
   [junit4]   1>         </requestHandler>
   [junit4]   1>       
   [junit4]   1>       
   [junit4]   1>         <!-- Query Elevation Component
   [junit4]   1>       
   [junit4]   1>              http://wiki.apache.org/solr/QueryElevationComponent
   [junit4]   1>       
   [junit4]   1>              a search component that enables you to configure the top
   [junit4]   1>              results for a given query regardless of the normal lucene
   [junit4]   1>              scoring.
   [junit4]   1>           -->
   [junit4]   1>         <searchComponent name="elevator" class="solr.QueryElevationComponent" >
   [junit4]   1>           <!-- pick a fieldType to analyze queries -->
   [junit4]   1>           <str name="queryFieldType">string</str>
   [junit4]   1>         </searchComponent>
   [junit4]   1>       
   [junit4]   1>         <!-- A request handler for demonstrating the elevator component -->
   [junit4]   1>         <requestHandler name="/elevate" class="solr.SearchHandler" startup="lazy">
   [junit4]   1>           <lst name="defaults">
   [junit4]   1>             <str name="echoParams">explicit</str>
   [junit4]   1>           </lst>
   [junit4]   1>           <arr name="last-components">
   [junit4]   1>             <str>elevator</str>
   [junit4]   1>           </arr>
   [junit4]   1>         </requestHandler>
   [junit4]   1>       
   [junit4]   1>         <!-- Highlighting Component
   [junit4]   1>       
   [junit4]   1>              http://wiki.apache.org/solr/HighlightingParameters
   [junit4]   1>           -->
   [junit4]   1>         <searchComponent class="solr.HighlightComponent" name="highlight">
   [junit4]   1>           <highlighting>
   [junit4]   1>             <!-- Configure the standard fragmenter -->
   [junit4]   1>             <!-- This could most likely be commented out in the "default" case -->
   [junit4]   1>             <fragmenter name="gap"
   [junit4]   1>                         default="true"
   [junit4]   1>                         class="solr.highlight.GapFragmenter">
   [junit4]   1>               <lst name="defaults">
   [junit4]   1>                 <int name="hl.fragsize">100</int>
   [junit4]   1>               </lst>
   [junit4]   1>             </fragmenter>
   [junit4]   1>       
   [junit4]   1>             <!-- A regular-expression-based fragmenter
   [junit4]   1>                  (for sentence extraction)
   [junit4]   1>               -->
   [junit4]   1>             <fragmenter name="regex"
   [junit4]   1>                         class="solr.highlight.RegexFragmenter">
   [junit4]   1>               <lst name="defaults">
   [junit4]   1>                 <!-- slightly smaller fragsizes work better because of slop -->
   [junit4]   1>                 <int name="hl.fragsize">70</int>
   [junit4]   1>                 <!-- allow 50% slop on fragment sizes -->
   [junit4]   1>                 <float name="hl.regex.slop">0.5</float>
   [junit4]   1>                 <!-- a basic sentence pattern -->
   [junit4]   1>                 <str name="hl.regex.pattern">[-\w ,/\n\&quot;&apos;]{20,200}</str>
   [junit4]   1>               </lst>
   [junit4]   1>             </fragmenter>
   [junit4]   1>       
   [junit4]   1>             <!-- Configure the standard formatter -->
   [junit4]   1>             <formatter name="html"
   [junit4]   1>                        default="true"
   [junit4]   1>                        class="solr.highlight.HtmlFormatter">
   [junit4]   1>               <lst name="defaults">
   [junit4]   1>                 <str name="hl.simple.pre"><![CDATA[<em>]]></str>
   [junit4]   1>                 <str name="hl.simple.post"><![CDATA[</em>]]></str>
   [junit4]   1>               </lst>
   [junit4]   1>             </formatter>
   [junit4]   1>       
   [junit4]   1>             <!-- Configure the standard encoder -->
   [junit4]   1>             <encoder name="html"
   [junit4]   1>                      class="solr.highlight.HtmlEncoder" />
   [junit4]   1>       
   [junit4]   1>             <!-- Configure the standard fragListBuilder -->
   [junit4]   1>             <fragListBuilder name="simple"
   [junit4]   1>                              class="solr.highlight.SimpleFragListBuilder"/>
   [junit4]   1>       
   [junit4]   1>             <!-- Configure the single fragListBuilder -->
   [junit4]   1>             <fragListBuilder name="single"
   [junit4]   1>                              class="solr.highlight.SingleFragListBuilder"/>
   [junit4]   1>       
   [junit4]   1>             <!-- Configure the weighted fragListBuilder -->
   [junit4]   1>             <fragListBuilder name="weighted"
   [junit4]   1>                              default="true"
   [junit4]   1>                              class="solr.highlight.WeightedFragListBuilder"/>
   [junit4]   1>       
   [junit4]   1>             <!-- default tag FragmentsBuilder -->
   [junit4]   1>             <fragmentsBuilder name="default"
   [junit4]   1>                               default="true"
   [junit4]   1>                               class="solr.highlight.ScoreOrderFragmentsBuilder">
   [junit4]   1>               <!--
   [junit4]   1>               <lst name="defaults">
   [junit4]   1>                 <str name="hl.multiValuedSeparatorChar">/</str>
   [junit4]   1>               </lst>
   [junit4]   1>               -->
   [junit4]   1>             </fragmentsBuilder>
   [junit4]   1>       
   [junit4]   1>             <!-- multi-colored tag FragmentsBuilder -->
   [junit4]   1>             <fragmentsBuilder name="colored"
   [junit4]   1>                               class="solr.highlight.ScoreOrderFragmentsBuilder">
   [junit4]   1>               <lst name="defaults">
   [junit4]   1>                 <str name="hl.tag.pre"><![CDATA[
   [junit4]   1>                      <b style="background:yellow">,<b style="background:lawgreen">,
   [junit4]   1>                      <b style="background:aquamarine">,<b style="background:magenta">,
   [junit4]   1>                      <b style="background:palegreen">,<b style="background:coral">,
   [junit4]   1>                      <b style="background:wheat">,<b style="background:khaki">,
   [junit4]   1>                      <b style="background:lime">,<b style="background:deepskyblue">]]></str>
   [junit4]   1>                 <str name="hl.tag.post"><![CDATA[</b>]]></str>
   [junit4]   1>               </lst>
   [junit4]   1>             </fragmentsBuilder>
   [junit4]   1>       
   [junit4]   1>             <boundaryScanner name="default"
   [junit4]   1>                              default="true"
   [junit4]   1>                              class="solr.highlight.SimpleBoundaryScanner">
   [junit4]   1>               <lst name="defaults">
   [junit4]   1>                 <str name="hl.bs.maxScan">10</str>
   [junit4]   1>                 <str name="hl.bs.chars">.,!? &#9;&#10;&#13;</str>
   [junit4]   1>               </lst>
   [junit4]   1>             </boundaryScanner>
   [junit4]   1>       
   [junit4]   1>             <boundaryScanner name="breakIterator"
   [junit4]   1>                              class="solr.highlight.BreakIteratorBoundaryScanner">
   [junit4]   1>               <lst name="defaults">
   [junit4]   1>                 <!-- type should be one of CHARACTER, WORD(default), LINE and SENTENCE -->
   [junit4]   1>                 <str name="hl.bs.type">WORD</str>
   [junit4]   1>                 <!-- language and country are used when constructing Locale object.  -->
   [junit4]   1>                 <!-- And the Locale object will be used when getting instance of BreakIterator -->
   [junit4]   1>                 <str name="hl.bs.language">en</str>
   [junit4]   1>                 <str name="hl.bs.country">US</str>
   [junit4]   1>               </lst>
   [junit4]   1>             </boundaryScanner>
   [junit4]   1>           </highlighting>
   [junit4]   1>         </searchComponent>
   [junit4]   1>       
   [junit4]   1>         <!-- Update Processors
   [junit4]   1>       
   [junit4]   1>              Chains of Update Processor Factories for dealing with Update
   [junit4]   1>              Requests can be declared, and then used by name in Update
   [junit4]   1>              Request Processors
   [junit4]   1>       
   [junit4]   1>              http://wiki.apache.org/solr/UpdateRequestProcessor
   [junit4]   1>       
   [junit4]   1>           -->
   [junit4]   1>       
   [junit4]   1>         <!-- Add unknown fields to the schema
   [junit4]   1>       
   [junit4]   1>              Field type guessing update processors that will
   [junit4]   1>              attempt to parse string-typed field values as Booleans, Longs,
   [junit4]   1>              Doubles, or Dates, and then add schema fields with the guessed
   [junit4]   1>              field types. Text content will be indexed as "text_general" as
   [junit4]   1>              well as a copy to a plain string version in *_str.
   [junit4]   1>       
   [junit4]   1>              These require that the schema is both managed and mutable, by
   [junit4]   1>              declaring schemaFactory as ManagedIndexSchemaFactory, with
   [junit4]   1>              mutable specified as true.
   [junit4]   1>       
   [junit4]   1>              See http://wiki.apache.org/solr/GuessingFieldTypes
   [junit4]   1>           -->
   [junit4]   1>         <updateProcessor class="solr.UUIDUpdateProcessorFactory" name="uuid"/>
   [junit4]   1>         <updateProcessor class="solr.RemoveBlankFieldUpdateProcessorFactory" name="remove-blank"/>
   [junit4]   1>         <updateProcessor class="solr.FieldNameMutatingUpdateProcessorFactory" name="field-name-mutating">
   [junit4]   1>           <str name="pattern">[^\w-\.]</str>
   [junit4]   1>           <str name="replacement">_</str>
   [junit4]   1>         </updateProcessor>
   [junit4]   1>         <updateProcessor class="solr.ParseBooleanFieldUpdateProcessorFactory" name="parse-boolean"/>
   [junit4]   1>         <updateProcessor class="solr.ParseLongFieldUpdateProcessorFactory" name="parse-long"/>
   [junit4]   1>         <updateProcessor class="solr.ParseDoubleFieldUpdateProcessorFactory" name="parse-double"/>
   [junit4]   1>         <updateProcessor class="solr.ParseDateFieldUpdateProcessorFactory" name="parse-date">
   [junit4]   1>           <arr name="format">
   [junit4]   1>             <str>yyyy-MM-dd'T'HH:mm:ss.SSSZ</str>
   [junit4]   1>             <str>yyyy-MM-dd'T'HH:mm:ss,SSSZ</str>
   [junit4]   1>             <str>yyyy-MM-dd'T'HH:mm:ss.SSS</str>
   [junit4]   1>             <str>yyyy-MM-dd'T'HH:mm:ss,SSS</str>
   [junit4]   1>             <str>yyyy-MM-dd'T'HH:mm:ssZ</str>
   [junit4]   1>             <str>yyyy-MM-dd'T'HH:mm:ss</str>
   [junit4]   1>             <str>yyyy-MM-dd'T'HH:mmZ</str>
   [junit4]   1>             <str>yyyy-MM-dd'T'HH:mm</str>
   [junit4]   1>             <str>yyyy-MM-dd HH:mm:ss.SSSZ</str>
   [junit4]   1>             <str>yyyy-MM-dd HH:mm:ss,SSSZ</str>
   [junit4]   1>             <str>yyyy-MM-dd HH:mm:ss.SSS</str>
   [junit4]   1>             <str>yyyy-MM-dd HH:mm:ss,SSS</str>
   [junit4]   1>             <str>yyyy-MM-dd HH:mm:ssZ</str>
   [junit4]   1>             <str>yyyy-MM-dd HH:mm:ss</str>
   [junit4]   1>             <str>yyyy-MM-dd HH:mmZ</str>
   [junit4]   1>             <str>yyyy-MM-dd HH:mm</str>
   [junit4]   1>             <str>yyyy-MM-dd</str>
   [junit4]   1>           </arr>
   [junit4]   1>         </updateProcessor>
   [junit4]   1>         <updateProcessor class="solr.AddSchemaFieldsUpdateProcessorFactory" name="add-schema-fields">
   [junit4]   1>           <lst name="typeMapping">
   [junit4]   1>             <str name="valueClass">java.lang.String</str>
   [junit4]   1>             <str name="fieldType">text_general</str>
   [junit4]   1>             <lst name="copyField">
   [junit4]   1>               <str name="dest">*_str</str>
   [junit4]   1>               <int name="maxChars">256</int>
   [junit4]   1>             </lst>
   [junit4]   1>             <!-- Use as default mapping instead of defaultFieldType -->
   [junit4]   1>             <bool name="default">true</bool>
   [junit4]   1>           </lst>
   [junit4]   1>           <lst name="typeMapping">
   [junit4]   1>             <str name="valueClass">java.lang.Boolean</str>
   [junit4]   1>             <str name="fieldType">booleans</str>
   [junit4]   1>           </lst>
   [junit4]   1>           <lst name="typeMapping">
   [junit4]   1>             <str name="valueClass">java.util.Date</str>
   [junit4]   1>             <str name="fieldType">pdates</str>
   [junit4]   1>           </lst>
   [junit4]   1>           <lst name="typeMapping">
   [junit4]   1>             <str name="valueClass">java.lang.Long</str>
   [junit4]   1>             <str name="valueClass">java.lang.Integer</str>
   [junit4]   1>             <str name="fieldType">plongs</str>
   [junit4]   1>           </lst>
   [junit4]   1>           <lst name="typeMapping">
   [junit4]   1>             <str name="valueClass">java.lang.Number</str>
   [junit4]   1>             <str name="fieldType">pdoubles</str>
   [junit4]   1>           </lst>
   [junit4]   1>         </updateProcessor>
   [junit4]   1>       
   [junit4]   1>         <!-- The update.autoCreateFields property can be turned to false to disable schemaless mode -->
 

[...truncated too long message...]

:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 562790 WARN  (TEST-TestPullReplica.testKillLeader-seed#[E658B7954186D0F6]) [    ] o.a.s.c.TestPullReplica Jetty 33995 not running, probably some bad test. Starting it
   [junit4]   2> 562798 ERROR (TEST-TestPullReplica.testKillLeader-seed#[E658B7954186D0F6]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestPullReplica -Dtests.method=testKillLeader -Dtests.seed=E658B7954186D0F6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es-EC -Dtests.timezone=Kwajalein -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 96.3s J1 | TestPullReplica.testKillLeader <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Replica state not updated in cluster state
   [junit4]    > null
   [junit4]    > Live Nodes: [127.0.0.1:46677_solr, 127.0.0.1:33995_solr]
   [junit4]    > Last available state: DocCollection(pull_replica_test_kill_leader//collections/pull_replica_test_kill_leader/state.json/6)={
   [junit4]    >   "pullReplicas":"1",
   [junit4]    >   "replicationFactor":"1",
   [junit4]    >   "shards":{"shard1":{
   [junit4]    >       "range":"80000000-7fffffff",
   [junit4]    >       "state":"active",
   [junit4]    >       "replicas":{
   [junit4]    >         "core_node3":{
   [junit4]    >           "core":"pull_replica_test_kill_leader_shard1_replica_n1",
   [junit4]    >           "base_url":"https://127.0.0.1:33995/solr",
   [junit4]    >           "node_name":"127.0.0.1:33995_solr",
   [junit4]    >           "state":"down",
   [junit4]    >           "type":"NRT",
   [junit4]    >           "leader":"true"},
   [junit4]    >         "core_node4":{
   [junit4]    >           "core":"pull_replica_test_kill_leader_shard1_replica_p2",
   [junit4]    >           "base_url":"https://127.0.0.1:46677/solr",
   [junit4]    >           "node_name":"127.0.0.1:46677_solr",
   [junit4]    >           "state":"active",
   [junit4]    >           "type":"PULL"}}}},
   [junit4]    >   "router":{"name":"compositeId"},
   [junit4]    >   "maxShardsPerNode":"100",
   [junit4]    >   "autoAddReplicas":"false",
   [junit4]    >   "nrtReplicas":"1",
   [junit4]    >   "tlogReplicas":"0"}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E658B7954186D0F6:AF4E4321233D44A0]:0)
   [junit4]    > 	at org.apache.solr.cloud.SolrCloudTestCase.waitForState(SolrCloudTestCase.java:269)
   [junit4]    > 	at org.apache.solr.cloud.TestPullReplica.doTestNoLeader(TestPullReplica.java:401)
   [junit4]    > 	at org.apache.solr.cloud.TestPullReplica.testKillLeader(TestPullReplica.java:290)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 571385 WARN  (zkCallback-2013-thread-6-processing-n:127.0.0.1:46677_solr) [n:127.0.0.1:46677_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 571386 WARN  (zkCallback-2031-thread-1-processing-n:127.0.0.1:33995_solr) [n:127.0.0.1:33995_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 571388 ERROR (SUITE-TestPullReplica-seed#[E658B7954186D0F6]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 577928 WARN  (Thread-1330) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	19	/solr/configs/conf
   [junit4]   2> 	5	/solr/aliases.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	24	/solr/collections/pull_replica_test_create_delete/state.json
   [junit4]   2> 	23	/solr/collections/pull_replica_test_remove_all_writer_replicas/state.json
   [junit4]   2> 	21	/solr/collections/pull_replica_test_kill_pull_replica/state.json
   [junit4]   2> 	20	/solr/collections/pull_replica_test_kill_leader/state.json
   [junit4]   2> 	19	/solr/collections/pull_replica_test_add_remove_pull_replica/state.json
   [junit4]   2> 	13	/solr/collections/pull_replica_test_add_docs/state.json
   [junit4]   2> 	13	/solr/collections/pull_replica_test_real_time_get/state.json
   [junit4]   2> 	5	/solr/clusterstate.json
   [junit4]   2> 	5	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/overseer_elect/election/98537415732232197-127.0.0.1:46677_solr-n_0000000001
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/collections
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	2	/solr/overseer/queue
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 	2	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestPullReplica_E658B7954186D0F6-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {_version_=PostingsFormat(name=LuceneVarGapDocFreqInterval), foo=PostingsFormat(name=LuceneVarGapDocFreqInterval), id=PostingsFormat(name=Memory), foo_s=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{_version_=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1117, maxMBSortInHeap=7.873477024213348, sim=RandomSimilarity(queryNorm=true): {}, locale=es-EC, timezone=Kwajalein
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=92958920,total=298610688
   [junit4]   2> NOTE: All tests run in this JVM: [TestReplicationHandlerBackup, LargeFieldTest, ChaosMonkeySafeLeaderTest, AddBlockUpdateTest, SolrCloudExampleTest, DeleteReplicaTest, CSVRequestHandlerTest, ShardRoutingTest, BasicAuthIntegrationTest, TestRequestForwarding, TestSQLHandler, TestSolrCoreSnapshots, HdfsRecoverLeaseTest, TestBackupRepositoryFactory, TestFuzzyAnalyzedSuggestions, TestHashPartitioner, TestNumericTerms32, TolerantUpdateProcessorTest, DistributedTermsComponentTest, TestRestManager, TestHdfsCloudBackupRestore, CloudMLTQParserTest, TestMaxTokenLenTokenizer, TestHashQParserPlugin, SuggesterTSTTest, BlobRepositoryCloudTest, TestPartialUpdateDeduplication, DistribCursorPagingTest, TestSubQueryTransformerDistrib, SpatialFilterTest, CurrencyFieldTypeTest, TlogReplayBufferedWhileIndexingTest, TestValueSourceCache, GraphQueryTest, PrimUtilsTest, TestPullReplica]
   [junit4] Completed [155/732 (1!)] on J1 in 153.07s, 10 tests, 1 failure, 1 skipped <<< FAILURES!

[...truncated 155 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_E658B7954186D0F6-001/init-core-data-001
   [junit4]   2> 701921 WARN  (SUITE-SolrSlf4jReporterTest-seed#[E658B7954186D0F6]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=E658B7954186D0F6 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de-CH -Dtests.timezone=America/Campo_Grande -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 6.51s J1 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: No 'solr.node' logs in: {numFound=0,start=0,docs=[]}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([E658B7954186D0F6:B9BC9AA22A8A43B3]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:85)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_E658B7954186D0F6-001
   [junit4]   2> NOTE: test params are: codec=Lucene70, sim=RandomSimilarity(queryNorm=false): {}, locale=de-CH, timezone=America/Campo_Grande
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=86270040,total=298283008
   [junit4]   2> NOTE: All tests run in this JVM: [TestReplicationHandlerBackup, LargeFieldTest, ChaosMonkeySafeLeaderTest, AddBlockUpdateTest, SolrCloudExampleTest, DeleteReplicaTest, CSVRequestHandlerTest, ShardRoutingTest, BasicAuthIntegrationTest, TestRequestForwarding, TestSQLHandler, TestSolrCoreSnapshots, HdfsRecoverLeaseTest, TestBackupRepositoryFactory, TestFuzzyAnalyzedSuggestions, TestHashPartitioner, TestNumericTerms32, TolerantUpdateProcessorTest, DistributedTermsComponentTest, TestRestManager, TestHdfsCloudBackupRestore, CloudMLTQParserTest, TestMaxTokenLenTokenizer, TestHashQParserPlugin, SuggesterTSTTest, BlobRepositoryCloudTest, TestPartialUpdateDeduplication, DistribCursorPagingTest, TestSubQueryTransformerDistrib, SpatialFilterTest, CurrencyFieldTypeTest, TlogReplayBufferedWhileIndexingTest, TestValueSourceCache, GraphQueryTest, PrimUtilsTest, TestPullReplica, TestTrieFacet, TestNoOpRegenerator, StatsReloadRaceTest, LeaderElectionContextKeyTest, TestSolrCloudWithDelegationTokens, RestartWhileUpdatingTest, TestComplexPhraseLeadingWildcard, TestSolrFieldCacheBean, CollectionStateFormat2Test, BaseCdcrDistributedZkTest, BlockDirectoryTest, IndexSchemaTest, TestFiltering, MetricUtilsTest, ExitableDirectoryReaderTest, TestCustomStream, TestNumericTokenStream, TestSearchPerf, ConnectionReuseTest, SolrSlf4jReporterTest]
   [junit4] Completed [205/732 (2!)] on J1 in 6.56s, 1 test, 1 failure <<< FAILURES!

[...truncated 41068 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20365 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20365/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
No 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: No 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([63159D0C0E6136F5:3CF1B03B656DA5B0]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:85)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11897 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_63159D0C0E6136F5-001/init-core-data-001
   [junit4]   2> 1288119 WARN  (SUITE-SolrSlf4jReporterTest-seed#[63159D0C0E6136F5]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=24 numCloses=24
   [junit4]   2> 1288119 INFO  (SUITE-SolrSlf4jReporterTest-seed#[63159D0C0E6136F5]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 1288121 INFO  (SUITE-SolrSlf4jReporterTest-seed#[63159D0C0E6136F5]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1288122 INFO  (SUITE-SolrSlf4jReporterTest-seed#[63159D0C0E6136F5]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1288123 INFO  (TEST-SolrSlf4jReporterTest.testReporter-seed#[63159D0C0E6136F5]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testReporter
   [junit4]   2> 1294555 INFO  (TEST-SolrSlf4jReporterTest.testReporter-seed#[63159D0C0E6136F5]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testReporter
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=63159D0C0E6136F5 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de-GR -Dtests.timezone=America/Swift_Current -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 6.44s J1 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: No 'solr.node' logs in: {numFound=0,start=0,docs=[]}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([63159D0C0E6136F5:3CF1B03B656DA5B0]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:85)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1294557 INFO  (SUITE-SolrSlf4jReporterTest-seed#[63159D0C0E6136F5]-worker) [    ] o.a.s.SolrTestCaseJ4 ###deleteCore
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_63159D0C0E6136F5-001
   [junit4]   2> NOTE: test params are: codec=SimpleText, sim=RandomSimilarity(queryNorm=false): {}, locale=de-GR, timezone=America/Swift_Current
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=235294520,total=358612992
   [junit4]   2> NOTE: All tests run in this JVM: [StatelessScriptUpdateProcessorFactoryTest, TestQueryTypes, DeleteInactiveReplicaTest, DataDrivenBlockJoinTest, OverseerTaskQueueTest, AlternateDirectoryTest, TestRestManager, CollectionsAPISolrJTest, HighlighterTest, TestSchemaNameResource, StatsReloadRaceTest, TestLegacyFieldReuse, OverseerModifyCollectionTest, SubstringBytesRefFilterTest, EnumFieldTest, TestSchemaVersionResource, MoveReplicaTest, CollectionsAPIDistributedZkTest, TestCoreContainer, ScriptEngineTest, TestMiniSolrCloudClusterSSL, SolrMetricReporterTest, TestTrackingShardHandlerFactory, TestCloudDeleteByQuery, TestGraphMLResponseWriter, TestPostingsSolrHighlighter, MetricUtilsTest, TestXIncludeConfig, SpatialFilterTest, TestTlogReplica, HdfsChaosMonkeySafeLeaderTest, TestSolrCLIRunExample, TestPayloadScoreQParserPlugin, TestCloudManagedSchema, ClusterStateUpdateTest, TestReloadDeadlock, ShardRoutingCustomTest, RemoteQueryErrorTest, DistributedIntervalFacetingTest, ClassificationUpdateProcessorTest, LoggingHandlerTest, TestFieldResource, LargeFieldTest, TestReplicationHandlerBackup, AnalysisAfterCoreReloadTest, TestDocBasedVersionConstraints, AssignBackwardCompatibilityTest, BlobRepositoryCloudTest, TestSolrFieldCacheBean, WrapperMergePolicyFactoryTest, TestSweetSpotSimilarityFactory, TestRTGBase, TestChildDocTransformer, SoftAutoCommitTest, CoreAdminHandlerTest, CollectionStateFormat2Test, TestLeaderInitiatedRecoveryThread, TestDFISimilarityFactory, TestBM25SimilarityFactory, DistribCursorPagingTest, TestSystemIdResolver, TestAtomicUpdateErrorCases, SharedFSAutoReplicaFailoverUtilsTest, BasicFunctionalityTest, TestSolrConfigHandler, TestMaxTokenLenTokenizer, JSONWriterTest, TestSolrCloudWithHadoopAuthPlugin, TestClusterStateMutator, DistributedSuggestComponentTest, TermVectorComponentTest, TestSearchPerf, TestSolrCloudWithDelegationTokens, TestSha256AuthenticationProvider, TestRandomRequestDistribution, ResponseHeaderTest, TestCoreDiscovery, TestSolrConfigHandlerConcurrent, TestMaxScoreQueryParser, ForceLeaderTest, MoreLikeThisHandlerTest, CdcrReplicationHandlerTest, TestReloadAndDeleteDocs, TestAuthorizationFramework, TestInfoStreamLogging, CleanupOldIndexTest, DistanceFunctionTest, TestExactSharedStatsCache, TestNumericTokenStream, TestSolrJ, BitVectorTest, TestCloudSearcherWarming, ConvertedLegacyTest, SchemaVersionSpecificBehaviorTest, ZkCLITest, BadCopyFieldTest, HLLSerializationTest, TestSolrCoreSnapshots, TestSolrIndexConfig, ZkFailoverTest, ConnectionReuseTest, TestRawResponseWriter, SolrCloudExampleTest, HdfsSyncSliceTest, TestTrieFacet, BlockJoinFacetDistribTest, AtomicUpdatesTest, TestFuzzyAnalyzedSuggestions, TestSmileRequest, SliceStateTest, OpenCloseCoreStressTest, TestCollectionsAPIViaSolrCloudCluster, TestFieldCacheReopen, SolrSlf4jReporterTest]
   [junit4] Completed [353/732 (1!)] on J1 in 6.48s, 1 test, 1 failure <<< FAILURES!

[...truncated 40640 lines...]

Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+181) - Build # 20364 - Still Unstable!

Posted by Chris Hostetter <ho...@fucit.org>.
Pretty sure these failures are caused by the changes in SOLR-10628 -- see 
more detailed comments there -- but I'm not 100% certain because i can't 
figure out a quick & painless way to tell the test runner "run these N 
explicit tests in a single JVM in this order" so i can write a git bisect 
script to verify....

https://issues.apache.org/jira/browse/SOLR-10628


: Date: Wed, 23 Aug 2017 18:26:05 -0700 (MST)
: From: Chris Hostetter <ho...@fucit.org>
: To: dev@lucene.apache.org
: Subject: Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+181) -
:     Build # 20364 - Still Unstable!
: 
: : FAILED:  org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping
: : 
: : Error Message:
: : Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
: 
: This failure reproduces for me when i run the whole test suite with this 
: seed (on java9) but *NOT* when running just this class.
: 
: I suspect some other recent test addition/modification is causing another 
: test class to muck with teh logging levels in the same JVM before this 
: test runs.
: 
: Test in the same JVM from my reproduce....
: 
: 
:   [junit4]   2> NOTE: reproduce with: ant test  
: -Dtestcase=UpdateRequestProcessorFactoryTest 
: -Dtests.method=testUpdateDistribChainSkipping 
: -Dtests.seed=81E0D214382D973D -Dtests.slow=true -Dtests.locale=mgo 
: -Dtests.timezone=Greenwich -Dtests.asserts=true 
: -Dtests.file.encoding=UTF-8
:    [junit4] FAILURE 0.00s J0 | 
: UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping <<<
:    [junit4]    > Throwable #1: java.lang.AssertionError: Tests must be run 
: with INFO level logging otherwise LogUpdateProcessor isn't used and can't 
: be tested.
:    [junit4]    > 	at 
: __randomizedtesting.SeedInfo.seed([81E0D214382D973D:F0042CC24EC6B0F1]:0)
:    [junit4]    > 	at 
: org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
:    [junit4]    > 	at 
: java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native 
: Method)
:    [junit4]    > 	at 
: java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
:    [junit4]    > 	at 
: java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
:    [junit4]    > 	at 
: java.base/java.lang.reflect.Method.invoke(Method.java:564)
:    [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
:    [junit4]   2> NOTE: leaving temporary files on disk at: 
: /home/hossman/lucene/dev/solr/build/solr-core/test/J0/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_81E0D214382D973D-001
:    [junit4]   2> Aug 23, 2017 6:11:16 PM 
: com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
:    [junit4]   2> WARNING: Will linger awaiting termination of 3 leaked 
: thread(s).
:    [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, 
: docValues:{}, maxPointsInLeafNode=858, maxMBSortInHeap=5.748797783397541, 
: sim=RandomSimilarity(queryNorm=false): {}, locale=mgo, timezone=Greenwich
:    [junit4]   2> NOTE: Linux 3.19.0-84-generic amd64/Oracle Corporation 9 
: (64-bit)/cpus=4,threads=1,free=277623552,total=536870912
:    [junit4]   2> NOTE: All tests run in this JVM: [NumericFieldsTest, 
: HdfsWriteToMultipleCollectionsTest, TestFieldCacheSort, 
: TestNumericTokenStream, QueryElevationComponentTest, MoveReplicaTest, 
: CdcrReplicationDistributedZkTest, DocumentAnalysisRequestHandlerTest, 
: SolrMetricsIntegrationTest, SolrCloudExampleTest, SampleTest, 
: TestQueryUtils, ExitableDirectoryReaderTest, TestReload, 
: TestCloudJSONFacetJoinDomain, TestQueryTypes, 
: OutOfBoxZkACLAndCredentialsProvidersTest, TestCloudSearcherWarming, 
: BasicDistributedZkTest, TestCustomDocTransformer, TestJoin, 
: TestManagedSynonymGraphFilterFactory, TestMissingGroups, 
: DocValuesMultiTest, TestFieldCacheReopen, HdfsSyncSliceTest, 
: NoCacheHeaderTest, TestFastOutputStream, ShardRoutingCustomTest, 
: TestDownShardTolerantSearch, TestPerFieldSimilarityWithDefaultOverride, 
: TestSolrCoreProperties, SolrCLIZkUtilsTest, TestSolrIndexConfig, 
: DefaultValueUpdateProcessorTest, FileBasedSpellCheckerTest, 
: ChaosMonkeySafeLeaderTest, V2ApiIntegrationTest, TestPerFieldSimilarity, 
: TestDistributedGrouping, CursorMarkTest, CollectionsAPISolrJTest, 
: StatelessScriptUpdateProcessorFactoryTest, TestLegacyField, 
: TestCollectionAPIs, ReplaceNodeTest, TestManagedResourceStorage, 
: TestFuzzyAnalyzedSuggestions, SpatialRPTFieldTypeTest, 
: TestDistribDocBasedVersion, SolrJmxReporterCloudTest, StatsReloadRaceTest, 
: TestStressLucene, SolrXmlInZkTest, HdfsRecoveryZkTest, 
: TestMergePolicyConfig, DisMaxRequestHandlerTest, 
: CollectionStateFormat2Test, TestShardHandlerFactory, RankQueryTest, 
: TestTolerantUpdateProcessorRandomCloud, 
: DistribDocExpirationUpdateProcessorTest, AnalyticsQueryTest, 
: SegmentsInfoRequestHandlerTest, FieldMutatingUpdateProcessorTest, 
: LeaderFailureAfterFreshStartTest, SharedFSAutoReplicaFailoverUtilsTest, 
: AddBlockUpdateTest, TestHighFrequencyDictionaryFactory, OverseerTest, 
: OverseerRolesTest, DeleteReplicaTest, PrimitiveFieldTypeTest, 
: DateRangeFieldTest, TestTrieFacet, TestSubQueryTransformerDistrib, 
: ClassificationUpdateProcessorFactoryTest, ScriptEngineTest, 
: PreAnalyzedUpdateProcessorTest, EchoParamsTest, TestSolr4Spatial, 
: TestQuerySenderNoQuery, ZkStateReaderTest, 
: ConcurrentDeleteAndCreateCollectionTest, DistributedFacetPivotLargeTest, 
: TestUninvertingReader, V2StandaloneTest, BJQParserTest, TestRTimerTree, 
: SaslZkACLProviderTest, CurrencyFieldTypeTest, TestSolrConfigHandlerCloud, 
: PathHierarchyTokenizerFactoryTest, TestExactStatsCache, TestUtils, 
: ActionThrottleTest, LeaderInitiatedRecoveryOnCommitTest, 
: TestStressLiveNodes, TestClusterStateMutator, SpellingQueryConverterTest, 
: UpdateLogTest, DistributedFacetExistsSmallTest, TestJettySolrRunner, 
: SortByFunctionTest, TestSolrConfigHandlerConcurrent, 
: PingRequestHandlerTest, TestPostingsSolrHighlighter, 
: TestGraphTermsQParserPlugin, AnalysisAfterCoreReloadTest, 
: TestMaxTokenLenTokenizer, TestSolrDeletionPolicy2, 
: TestSolrCloudWithSecureImpersonation, TestIBSimilarityFactory, 
: HdfsDirectoryTest, SolrRequestParserTest, DistributedDebugComponentTest, 
: TestConfigSetsAPIZkFailure, TestSolrConfigHandler, 
: TestInPlaceUpdatesDistrib, TestTlogReplica, 
: CollectionsAPIDistributedZkTest, TestPullReplica, TestCloudSchemaless, 
: LeaderFailoverAfterPartitionTest, CdcrBootstrapTest, TestRebalanceLeaders, 
: SoftAutoCommitTest, TestRequestStatusCollectionAPI, ShardRoutingTest, 
: SolrShardReporterTest, MoveReplicaHDFSUlogDirTest, HdfsNNFailoverTest, 
: AnalyticsMergeStrategyTest, LeaderElectionTest, RulesTest, 
: HdfsRecoverLeaseTest, TestNamedUpdateProcessors, TestCustomStream, 
: TestLocalFSCloudBackupRestore, TriLevelCompositeIdRoutingTest, 
: TestRandomFaceting, TestAuthenticationFramework, 
: TestLeaderElectionZkExpiry, HdfsDirectoryFactoryTest, 
: AliasIntegrationTest, TestRecovery, TestSSLRandomization, 
: OverseerTaskQueueTest, BasicAuthIntegrationTest, 
: CachingDirectoryFactoryTest, DocValuesNotIndexedTest, 
: TestSolrCoreSnapshots, TestCloudDeleteByQuery, ConnectionManagerTest, 
: TestRequestForwarding, HardAutoCommitTest, 
: DeleteLastCustomShardedReplicaTest, BasicZkTest, TestManagedSchema, 
: SolrCmdDistributorTest, TestSolrCloudWithDelegationTokens, 
: SpellCheckComponentTest, TestImpersonationWithHadoopAuth, 
: OverseerCollectionConfigSetProcessorTest, TestNumericRangeQuery64, 
: EnumFieldTest, TestConfigSetImmutable, 
: DistributedFacetPivotSmallAdvancedTest, TestBadConfig, TestNumericTerms32, 
: BlockCacheTest, TestManagedSchemaThreadSafety, TestFieldCacheVsDocValues, 
: TestTrie, TestRestManager, DirectUpdateHandlerTest, HighlighterTest, 
: TestFoldingMultitermQuery, TestNumericRangeQuery32, TestFunctionQuery, 
: TestUseDocValuesAsStored2, ConvertedLegacyTest, TestExportWriter, 
: TestCursorMarkWithoutUniqueKey, TestTolerantSearch, 
: TestOverriddenPrefixQueryForCustomFieldType, SpatialFilterTest, 
: TestSolrQueryParser, TestNRTOpen, TestFieldSortValues, 
: TestSortByMinMaxFunction, TestFieldTypeResource, SuggesterTSTTest, 
: TestFieldTypeCollectionResource, CacheHeaderTest, TestReRankQParserPlugin, 
: TestRemoteStreaming, CopyFieldTest, TestSchemaVersionResource, 
: DebugComponentTest, SmileWriterTest, SOLR749Test, SolrPluginUtilsTest, 
: TestQuerySenderListener, JsonLoaderTest, 
: ClassificationUpdateProcessorTest, TestGraphMLResponseWriter, 
: UniqFieldsUpdateProcessorFactoryTest, CoreMergeIndexesAdminHandlerTest, 
: RequiredFieldsTest, TestCollationField, UpdateRequestProcessorFactoryTest]
:    [junit4] Completed [619/732 (1!)] on J0 in 1.17s, 3 tests, 1 failure 
: <<< FAILURES!
: 
: 
: 
: 
: -Hoss
: http://www.lucidworks.com/
: 

-Hoss
http://www.lucidworks.com/

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: [JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+181) - Build # 20364 - Still Unstable!

Posted by Chris Hostetter <ho...@fucit.org>.
: FAILED:  org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping
: 
: Error Message:
: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.

This failure reproduces for me when i run the whole test suite with this 
seed (on java9) but *NOT* when running just this class.

I suspect some other recent test addition/modification is causing another 
test class to muck with teh logging levels in the same JVM before this 
test runs.

Test in the same JVM from my reproduce....


  [junit4]   2> NOTE: reproduce with: ant test  
-Dtestcase=UpdateRequestProcessorFactoryTest 
-Dtests.method=testUpdateDistribChainSkipping 
-Dtests.seed=81E0D214382D973D -Dtests.slow=true -Dtests.locale=mgo 
-Dtests.timezone=Greenwich -Dtests.asserts=true 
-Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.00s J0 | 
UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Tests must be run 
with INFO level logging otherwise LogUpdateProcessor isn't used and can't 
be tested.
   [junit4]    > 	at 
__randomizedtesting.SeedInfo.seed([81E0D214382D973D:F0042CC24EC6B0F1]:0)
   [junit4]    > 	at 
org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
   [junit4]    > 	at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native 
Method)
   [junit4]    > 	at 
java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at 
java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at 
java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: leaving temporary files on disk at: 
/home/hossman/lucene/dev/solr/build/solr-core/test/J0/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_81E0D214382D973D-001
   [junit4]   2> Aug 23, 2017 6:11:16 PM 
com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 3 leaked 
thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, 
docValues:{}, maxPointsInLeafNode=858, maxMBSortInHeap=5.748797783397541, 
sim=RandomSimilarity(queryNorm=false): {}, locale=mgo, timezone=Greenwich
   [junit4]   2> NOTE: Linux 3.19.0-84-generic amd64/Oracle Corporation 9 
(64-bit)/cpus=4,threads=1,free=277623552,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [NumericFieldsTest, 
HdfsWriteToMultipleCollectionsTest, TestFieldCacheSort, 
TestNumericTokenStream, QueryElevationComponentTest, MoveReplicaTest, 
CdcrReplicationDistributedZkTest, DocumentAnalysisRequestHandlerTest, 
SolrMetricsIntegrationTest, SolrCloudExampleTest, SampleTest, 
TestQueryUtils, ExitableDirectoryReaderTest, TestReload, 
TestCloudJSONFacetJoinDomain, TestQueryTypes, 
OutOfBoxZkACLAndCredentialsProvidersTest, TestCloudSearcherWarming, 
BasicDistributedZkTest, TestCustomDocTransformer, TestJoin, 
TestManagedSynonymGraphFilterFactory, TestMissingGroups, 
DocValuesMultiTest, TestFieldCacheReopen, HdfsSyncSliceTest, 
NoCacheHeaderTest, TestFastOutputStream, ShardRoutingCustomTest, 
TestDownShardTolerantSearch, TestPerFieldSimilarityWithDefaultOverride, 
TestSolrCoreProperties, SolrCLIZkUtilsTest, TestSolrIndexConfig, 
DefaultValueUpdateProcessorTest, FileBasedSpellCheckerTest, 
ChaosMonkeySafeLeaderTest, V2ApiIntegrationTest, TestPerFieldSimilarity, 
TestDistributedGrouping, CursorMarkTest, CollectionsAPISolrJTest, 
StatelessScriptUpdateProcessorFactoryTest, TestLegacyField, 
TestCollectionAPIs, ReplaceNodeTest, TestManagedResourceStorage, 
TestFuzzyAnalyzedSuggestions, SpatialRPTFieldTypeTest, 
TestDistribDocBasedVersion, SolrJmxReporterCloudTest, StatsReloadRaceTest, 
TestStressLucene, SolrXmlInZkTest, HdfsRecoveryZkTest, 
TestMergePolicyConfig, DisMaxRequestHandlerTest, 
CollectionStateFormat2Test, TestShardHandlerFactory, RankQueryTest, 
TestTolerantUpdateProcessorRandomCloud, 
DistribDocExpirationUpdateProcessorTest, AnalyticsQueryTest, 
SegmentsInfoRequestHandlerTest, FieldMutatingUpdateProcessorTest, 
LeaderFailureAfterFreshStartTest, SharedFSAutoReplicaFailoverUtilsTest, 
AddBlockUpdateTest, TestHighFrequencyDictionaryFactory, OverseerTest, 
OverseerRolesTest, DeleteReplicaTest, PrimitiveFieldTypeTest, 
DateRangeFieldTest, TestTrieFacet, TestSubQueryTransformerDistrib, 
ClassificationUpdateProcessorFactoryTest, ScriptEngineTest, 
PreAnalyzedUpdateProcessorTest, EchoParamsTest, TestSolr4Spatial, 
TestQuerySenderNoQuery, ZkStateReaderTest, 
ConcurrentDeleteAndCreateCollectionTest, DistributedFacetPivotLargeTest, 
TestUninvertingReader, V2StandaloneTest, BJQParserTest, TestRTimerTree, 
SaslZkACLProviderTest, CurrencyFieldTypeTest, TestSolrConfigHandlerCloud, 
PathHierarchyTokenizerFactoryTest, TestExactStatsCache, TestUtils, 
ActionThrottleTest, LeaderInitiatedRecoveryOnCommitTest, 
TestStressLiveNodes, TestClusterStateMutator, SpellingQueryConverterTest, 
UpdateLogTest, DistributedFacetExistsSmallTest, TestJettySolrRunner, 
SortByFunctionTest, TestSolrConfigHandlerConcurrent, 
PingRequestHandlerTest, TestPostingsSolrHighlighter, 
TestGraphTermsQParserPlugin, AnalysisAfterCoreReloadTest, 
TestMaxTokenLenTokenizer, TestSolrDeletionPolicy2, 
TestSolrCloudWithSecureImpersonation, TestIBSimilarityFactory, 
HdfsDirectoryTest, SolrRequestParserTest, DistributedDebugComponentTest, 
TestConfigSetsAPIZkFailure, TestSolrConfigHandler, 
TestInPlaceUpdatesDistrib, TestTlogReplica, 
CollectionsAPIDistributedZkTest, TestPullReplica, TestCloudSchemaless, 
LeaderFailoverAfterPartitionTest, CdcrBootstrapTest, TestRebalanceLeaders, 
SoftAutoCommitTest, TestRequestStatusCollectionAPI, ShardRoutingTest, 
SolrShardReporterTest, MoveReplicaHDFSUlogDirTest, HdfsNNFailoverTest, 
AnalyticsMergeStrategyTest, LeaderElectionTest, RulesTest, 
HdfsRecoverLeaseTest, TestNamedUpdateProcessors, TestCustomStream, 
TestLocalFSCloudBackupRestore, TriLevelCompositeIdRoutingTest, 
TestRandomFaceting, TestAuthenticationFramework, 
TestLeaderElectionZkExpiry, HdfsDirectoryFactoryTest, 
AliasIntegrationTest, TestRecovery, TestSSLRandomization, 
OverseerTaskQueueTest, BasicAuthIntegrationTest, 
CachingDirectoryFactoryTest, DocValuesNotIndexedTest, 
TestSolrCoreSnapshots, TestCloudDeleteByQuery, ConnectionManagerTest, 
TestRequestForwarding, HardAutoCommitTest, 
DeleteLastCustomShardedReplicaTest, BasicZkTest, TestManagedSchema, 
SolrCmdDistributorTest, TestSolrCloudWithDelegationTokens, 
SpellCheckComponentTest, TestImpersonationWithHadoopAuth, 
OverseerCollectionConfigSetProcessorTest, TestNumericRangeQuery64, 
EnumFieldTest, TestConfigSetImmutable, 
DistributedFacetPivotSmallAdvancedTest, TestBadConfig, TestNumericTerms32, 
BlockCacheTest, TestManagedSchemaThreadSafety, TestFieldCacheVsDocValues, 
TestTrie, TestRestManager, DirectUpdateHandlerTest, HighlighterTest, 
TestFoldingMultitermQuery, TestNumericRangeQuery32, TestFunctionQuery, 
TestUseDocValuesAsStored2, ConvertedLegacyTest, TestExportWriter, 
TestCursorMarkWithoutUniqueKey, TestTolerantSearch, 
TestOverriddenPrefixQueryForCustomFieldType, SpatialFilterTest, 
TestSolrQueryParser, TestNRTOpen, TestFieldSortValues, 
TestSortByMinMaxFunction, TestFieldTypeResource, SuggesterTSTTest, 
TestFieldTypeCollectionResource, CacheHeaderTest, TestReRankQParserPlugin, 
TestRemoteStreaming, CopyFieldTest, TestSchemaVersionResource, 
DebugComponentTest, SmileWriterTest, SOLR749Test, SolrPluginUtilsTest, 
TestQuerySenderListener, JsonLoaderTest, 
ClassificationUpdateProcessorTest, TestGraphMLResponseWriter, 
UniqFieldsUpdateProcessorFactoryTest, CoreMergeIndexesAdminHandlerTest, 
RequiredFieldsTest, TestCollationField, UpdateRequestProcessorFactoryTest]
   [junit4] Completed [619/732 (1!)] on J0 in 1.17s, 3 tests, 1 failure 
<<< FAILURES!




-Hoss
http://www.lucidworks.com/

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+181) - Build # 20364 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20364/
Java: 64bit/jdk-9-ea+181 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC --illegal-access=deny

3 tests failed.
FAILED:  org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete

Error Message:
Error from server at https://127.0.0.1:43303/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason: <pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:43303/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([81E0D214382D973D:221A7CB1BFC57D98]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
	at org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete(TestCollectionsAPIViaSolrCloudCluster.java:167)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:43303/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	... 1 more


FAILED:  org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping

Error Message:
Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.

Stack Trace:
java.lang.AssertionError: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
	at __randomizedtesting.SeedInfo.seed([81E0D214382D973D:F0042CC24EC6B0F1]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)


FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
No 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: No 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([81E0D214382D973D:DE04FF2353210478]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:85)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 1693 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J2-20170823_205313_6054761253643749772536.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J1-20170823_205313_6072516029215173096691.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/core/test/temp/junit4-J0-20170823_205313_60513079333154495054053.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 265 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J1-20170823_210030_5487278030006448313233.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 24 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J0-20170823_210030_5445893551294530594902.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 5 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/test-framework/test/temp/junit4-J2-20170823_210030_54814157633927889083165.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 1033 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J1-20170823_210157_01610072201462480294783.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J2-20170823_210157_0173870263829952253960.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/common/test/temp/junit4-J0-20170823_210157_016404440181178075309.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 221 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J2-20170823_210335_61118201160646388373066.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J1-20170823_210335_60513701178356288557417.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/icu/test/temp/junit4-J0-20170823_210335_60512004841871467832040.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 234 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J0-20170823_210345_7759792528926191499794.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J2-20170823_210345_77516716638558674716547.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/kuromoji/test/temp/junit4-J1-20170823_210345_7755444738607975851721.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 146 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J1-20170823_210406_7687906524856610595093.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J2-20170823_210406_76714029264780637465162.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/morfologik/test/temp/junit4-J0-20170823_210406_7679165687407374257082.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 158 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J2-20170823_210410_0966210460299453834885.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J1-20170823_210410_0967962024989328627718.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/phonetic/test/temp/junit4-J0-20170823_210410_0965684409059344279183.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 145 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J0-20170823_210419_26813664999367292012464.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/smartcn/test/temp/junit4-J1-20170823_210419_2686694144467094756361.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 146 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J1-20170823_210425_84010677202813098810482.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J2-20170823_210425_84013232074912173237484.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/stempel/test/temp/junit4-J0-20170823_210425_8403045579778166469369.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 161 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/analysis/uima/test/temp/junit4-J0-20170823_210428_43814975447474581952023.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 145 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J0-20170823_210435_54911301923532249683542.syserr
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J1-20170823_210435_54913354188130328075491.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 28 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/backward-codecs/test/temp/junit4-J2-20170823_210435_5493274201044294753135.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 1206 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J1-20170823_210446_1591242788883182787435.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J2-20170823_210446_1593990531535316591216.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/benchmark/test/temp/junit4-J0-20170823_210446_15911096547335613151323.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 223 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J1-20170823_210454_0954840378772172923476.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J2-20170823_210454_09513715842335904616467.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/classification/test/temp/junit4-J0-20170823_210454_0957466425563842982500.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 242 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J1-20170823_210504_91116690748234028746190.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 7 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J2-20170823_210504_9112041550282245512910.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 9 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/codecs/test/temp/junit4-J0-20170823_210504_9119021392164819419103.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 223 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J2-20170823_210750_751809323013346106757.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J1-20170823_210750_7512814584225404301624.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/demo/test/temp/junit4-J0-20170823_210750_75011405745007067670842.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 165 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J1-20170823_210753_3984460641754927482649.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J2-20170823_210753_4048231648920459494550.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/expressions/test/temp/junit4-J0-20170823_210753_39710169554148450356859.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 207 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J0-20170823_210758_551190550725862176330.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J2-20170823_210758_55113416552034854099146.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/facet/test/temp/junit4-J1-20170823_210758_55117289319503842596102.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 171 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J1-20170823_210853_15110983936940931383798.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J2-20170823_210853_1525306324664914791651.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/grouping/test/temp/junit4-J0-20170823_210853_15110815906428483777086.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 238 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J0-20170823_210913_92311706623413612262443.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J2-20170823_210913_9238270545664363955602.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/highlighter/test/temp/junit4-J1-20170823_210913_92311001861636626154889.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 152 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J2-20170823_210942_8075289313936170880592.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J0-20170823_210942_80617061538488280466705.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/join/test/temp/junit4-J1-20170823_210942_8062543910221213070912.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 141 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J0-20170823_211000_5328128764990774221598.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/memory/test/temp/junit4-J1-20170823_211000_53215372842267407854922.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 172 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J1-20170823_211011_53312610695622927620310.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J0-20170823_211011_53317515784421661901291.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/misc/test/temp/junit4-J2-20170823_211011_5349265581004832249735.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 304 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J0-20170823_211028_3158662800873017718130.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J2-20170823_211028_3153184902551056311332.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queries/test/temp/junit4-J1-20170823_211028_31510216045138135975962.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 219 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J1-20170823_211036_26715086697954520634901.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J0-20170823_211036_26714450967854803703704.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/queryparser/test/temp/junit4-J2-20170823_211036_26713360756315993156115.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 193 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J1-20170823_211044_1847032061238892149361.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J2-20170823_211044_1841640066341035086035.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/replicator/test/temp/junit4-J0-20170823_211044_1842221757890465084123.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 204 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J1-20170823_211058_953876376320277471289.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J0-20170823_211058_95315813183354463213697.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/sandbox/test/temp/junit4-J2-20170823_211058_95311438028375597984784.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 207 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J1-20170823_211146_8238346005927601511925.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J0-20170823_211146_8236747094774531199044.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial-extras/test/temp/junit4-J2-20170823_211146_8231643608333060047793.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 140 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial/test/temp/junit4-J0-20170823_211202_07313900803952496378301.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 160 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J0-20170823_211205_09212463116583922550373.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J2-20170823_211205_09214811521536920109272.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 8 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/spatial3d/test/temp/junit4-J1-20170823_211205_0926544581324300672332.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 239 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J2-20170823_211319_7511352911497678382742.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 6 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J1-20170823_211319_75112576196031860724344.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/build/suggest/test/temp/junit4-J0-20170823_211319_751145737449420156092.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1792 lines...]
   [junit4] Suite: org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_81E0D214382D973D-001/init-core-data-001
   [junit4]   2> 441919 WARN  (SUITE-UpdateRequestProcessorFactoryTest-seed#[81E0D214382D973D]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> 442142 WARN  (coreLoadExecutor-1472-thread-1) [    ] o.a.s.c.RequestHandlers no default request handler is registered (either '/select' or 'standard')
   [junit4]   2> 442143 WARN  (coreLoadExecutor-1472-thread-1) [    ] o.a.s.r.ManagedResourceStorage Cannot write to config directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf; switching to use InMemory storage instead.
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=UpdateRequestProcessorFactoryTest -Dtests.method=testUpdateDistribChainSkipping -Dtests.seed=81E0D214382D973D -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=mgo -Dtests.timezone=Greenwich -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 0.00s J1 | UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Tests must be run with INFO level logging otherwise LogUpdateProcessor isn't used and can't be tested.
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([81E0D214382D973D:F0042CC24EC6B0F1]:0)
   [junit4]    > 	at org.apache.solr.update.processor.UpdateRequestProcessorFactoryTest.testUpdateDistribChainSkipping(UpdateRequestProcessorFactoryTest.java:101)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.update.processor.UpdateRequestProcessorFactoryTest_81E0D214382D973D-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=858, maxMBSortInHeap=5.748797783397541, sim=RandomSimilarity(queryNorm=false): {}, locale=mgo, timezone=Greenwich
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 9 (64-bit)/cpus=8,threads=1,free=226305568,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestConfigsApi, TestAtomicUpdateErrorCases, DistributedExpandComponentTest, TestSystemIdResolver, VersionInfoTest, ClassificationUpdateProcessorTest, MoreLikeThisHandlerTest, BasicAuthIntegrationTest, ConnectionManagerTest, TestSimpleTrackingShardHandler, TermVectorComponentTest, TestTrackingShardHandlerFactory, SolrCloudExampleTest, SpatialFilterTest, TestStressVersions, TestSchemaNameResource, TestManagedStopFilterFactory, TestReloadAndDeleteDocs, RestartWhileUpdatingTest, OverseerTaskQueueTest, CollectionsAPIDistributedZkTest, ConfigureRecoveryStrategyTest, TestBlobHandler, IndexSchemaRuntimeFieldTest, TestReplicationHandlerBackup, TestScoreJoinQPNoScore, TestPullReplica, TestClusterStateMutator, HighlighterTest, TestCloudPivotFacet, MetricUtilsTest, TestElisionMultitermQuery, TestConfigSetsAPIZkFailure, CurrencyFieldTypeTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TlogReplayBufferedWhileIndexingTest, UpdateRequestProcessorFactoryTest]
   [junit4] Completed [124/732 (1!)] on J1 in 0.25s, 3 tests, 1 failure <<< FAILURES!

[...truncated 43 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_81E0D214382D973D-001/init-core-data-001
   [junit4]   2> 502903 WARN  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[81E0D214382D973D]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=24 numCloses=24
   [junit4]   2> 502906 ERROR (Thread-742) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 503012 ERROR (jetty-launcher-534-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 503015 ERROR (jetty-launcher-534-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 503017 ERROR (jetty-launcher-534-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 503019 ERROR (jetty-launcher-534-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 503023 ERROR (jetty-launcher-534-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 503039 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fa318e0009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   1> -
   [junit4]   1> replica:core_node3 rstate:active live:true
   [junit4]   1> replica:core_node5 rstate:active live:true
   [junit4]   1> replica:core_node7 rstate:active live:true
   [junit4]   1> replica:core_node8 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   2> 508460 WARN  (zkCallback-563-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 509980 WARN  (zkCallback-557-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 511502 WARN  (zkCallback-545-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 513022 WARN  (zkCallback-555-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 513025 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[81E0D214382D973D]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 513033 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fa318e0013, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 514610 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[81E0D214382D973D]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 516188 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[81E0D214382D973D]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 517761 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[81E0D214382D973D]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> -
   [junit4]   1> replica:core_node3 rstate:down live:true
   [junit4]   1> replica:core_node5 rstate:down live:true
   [junit4]   1> replica:core_node7 rstate:active live:true
   [junit4]   1> replica:core_node8 rstate:recovering live:true
   [junit4]   1> -
   [junit4]   1> replica:core_node3 rstate:active live:true
   [junit4]   1> replica:core_node5 rstate:recovering live:true
   [junit4]   1> replica:core_node7 rstate:active live:true
   [junit4]   1> replica:core_node8 rstate:active live:true
   [junit4]   1> -
   [junit4]   1> replica:core_node3 rstate:active live:true
   [junit4]   1> replica:core_node5 rstate:recovering live:true
   [junit4]   1> replica:core_node7 rstate:active live:true
   [junit4]   1> replica:core_node8 rstate:active live:true
   [junit4]   1> -
   [junit4]   1> replica:core_node3 rstate:active live:true
   [junit4]   1> replica:core_node5 rstate:active live:true
   [junit4]   1> replica:core_node7 rstate:active live:true
   [junit4]   1> replica:core_node8 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   2> 522347 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[81E0D214382D973D]) [    ] o.a.s.c.s.i.CloudSolrClient Request to collection testStopAllStartAllCollection failed due to (510) org.apache.solr.common.SolrException: Could not find a healthy node to handle the request., retry? 0
   [junit4]   2> 522347 WARN  (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[81E0D214382D973D]) [    ] o.a.s.c.s.i.CloudSolrClient Re-trying request to  collection(s) testStopAllStartAllCollection after stale state error from server.
   [junit4]   2> 522367 WARN  (zkCallback-556-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 522390 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fa318e0017, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 522391 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fa318e001a, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 523888 WARN  (zkCallback-593-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 523890 WARN  (zkCallback-575-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 523891 WARN  (zkCallback-587-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 523890 WARN  (zkCallback-581-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 523891 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[81E0D214382D973D]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 523926 WARN  (Thread-742) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/aliases.json
   [junit4]   2> 	9	/solr/security.json
   [junit4]   2> 	8	/solr/configs/solrCloudCollectionConfig
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	79	/solr/collections/testStopAllStartAllCollection/state.json
   [junit4]   2> 	10	/solr/clusterprops.json
   [junit4]   2> 	10	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/overseer_elect/election/98534908607987724-127.0.0.1:39333_solr-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/98534908607987723-127.0.0.1:45997_solr-n_0000000002
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/collections
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 523928 ERROR (Thread-833) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 524033 ERROR (jetty-launcher-597-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 524036 ERROR (jetty-launcher-597-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 524037 ERROR (jetty-launcher-597-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 524037 ERROR (jetty-launcher-597-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 524037 ERROR (jetty-launcher-597-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 524066 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fa83ad0008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 524066 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fa83ad0007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 524066 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fa83ad0009, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 525856 WARN  (zkCallback-620-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 525859 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[81E0D214382D973D]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   1> -
   [junit4]   1> replica:core_node3 rstate:active live:true
   [junit4]   1> replica:core_node5 rstate:active live:true
   [junit4]   1> replica:core_node7 rstate:active live:true
   [junit4]   1> replica:core_node8 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   2> 529633 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fa83ad000d, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 531133 WARN  (zkCallback-622-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 531145 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[81E0D214382D973D]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 531549 WARN  (zkCallback-623-thread-2) [    ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
   [junit4]   2> 531570 WARN  (zkCallback-621-thread-1) [    ] o.a.s.c.LeaderElector Our node is no longer in line to be leader
   [junit4]   1> -
   [junit4]   1> -
   [junit4]   1> replica:core_node2 rstate:active live:true
   [junit4]   1> replica:core_node4 rstate:active live:true
   [junit4]   1> replica:core_node6 rstate:active live:true
   [junit4]   1> replica:core_node8 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   2> 535855 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[81E0D214382D973D]) [    ] o.a.s.c.s.i.CloudSolrClient Request to collection testcollection failed due to (404) org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:43303/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]   2> <head>
   [junit4]   2> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
   [junit4]   2> <title>Error 404 </title>
   [junit4]   2> </head>
   [junit4]   2> <body>
   [junit4]   2> <h2>HTTP ERROR: 404</h2>
   [junit4]   2> <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
   [junit4]   2> <pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
   [junit4]   2> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
   [junit4]   2> </body>
   [junit4]   2> </html>
   [junit4]   2> , retry? 0
   [junit4]   2> 535949 WARN  (zkCallback-621-thread-3) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 535949 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fa83ad000c, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 537404 WARN  (zkCallback-644-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 537445 WARN  (zkCallback-638-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 537446 WARN  (zkCallback-623-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 537452 WARN  (zkCallback-624-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 537453 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[81E0D214382D973D]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 537491 WARN  (Thread-833) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/aliases.json
   [junit4]   2> 	8	/solr/configs/solrCloudCollectionConfig
   [junit4]   2> 	7	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	50	/solr/collections/testcollection/state.json
   [junit4]   2> 	8	/solr/clusterprops.json
   [junit4]   2> 	8	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/overseer_elect/election/98534909985751052-127.0.0.1:40575_solr-n_0000000002
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	8	/solr/collections
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	2	/solr/overseer/queue
   [junit4]   2> 	2	/solr/overseer/queue-work
   [junit4]   2> 	2	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestCollectionsAPIViaSolrCloudCluster -Dtests.method=testCollectionCreateSearchDelete -Dtests.seed=81E0D214382D973D -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ko-KP -Dtests.timezone=Africa/Mbabane -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   13.6s J1 | TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete <<<
   [junit4]    > Throwable #1: org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at https://127.0.0.1:43303/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]    > <head>
   [junit4]    > <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
   [junit4]    > <title>Error 404 </title>
   [junit4]    > </head>
   [junit4]    > <body>
   [junit4]    > <h2>HTTP ERROR: 404</h2>
   [junit4]    > <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
   [junit4]    > <pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
   [junit4]    > <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
   [junit4]    > </body>
   [junit4]    > </html>
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([81E0D214382D973D:221A7CB1BFC57D98]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
   [junit4]    > 	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
   [junit4]    > 	at org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete(TestCollectionsAPIViaSolrCloudCluster.java:167)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]    > Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:43303/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
   [junit4]    > <head>
   [junit4]    > <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
   [junit4]    > <title>Error 404 </title>
   [junit4]    > </head>
   [junit4]    > <body>
   [junit4]    > <h2>HTTP ERROR: 404</h2>
   [junit4]    > <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
   [junit4]    > <pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
   [junit4]    > <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
   [junit4]    > </body>
   [junit4]    > </html>
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
   [junit4]    > 	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
   [junit4]    > 	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
   [junit4]    > 	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
   [junit4]    > 	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
   [junit4]    > 	... 1 more
   [junit4]   2> 537504 ERROR (Thread-904) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 537618 ERROR (jetty-launcher-646-thread-4) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 537618 ERROR (jetty-launcher-646-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 537619 ERROR (jetty-launcher-646-thread-3) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 537629 ERROR (jetty-launcher-646-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 537635 ERROR (jetty-launcher-646-thread-5) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 537658 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fab8b50004, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 537660 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fab8b50006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 537929 WARN  (OverseerThreadFactory-1972-thread-1) [    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (testSolrCloudCollectionWithoutCores) without cores.
   [junit4]   1> -
   [junit4]   1> no one is recoverying
   [junit4]   1> -
   [junit4]   2> 538777 WARN  (zkCallback-661-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 538777 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fab8b50008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 538779 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e10fab8b5000a, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 540275 WARN  (zkCallback-668-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 540276 WARN  (zkCallback-675-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 540277 WARN  (zkCallback-669-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 540279 WARN  (zkCallback-665-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 540279 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateWithoutCoresThenDelete-seed#[81E0D214382D973D]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 540340 WARN  (Thread-904) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	5	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_81E0D214382D973D-001
   [junit4]   2> Aug 23, 2017 9:23:43 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {_version_=FSTOrd50, id=BlockTreeOrds(blocksize=128)}, docValues:{_version_=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1792, maxMBSortInHeap=7.5644238166033855, sim=RandomSimilarity(queryNorm=false): {}, locale=ko-KP, timezone=Africa/Mbabane
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 9 (64-bit)/cpus=8,threads=1,free=193983992,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [TestConfigsApi, TestAtomicUpdateErrorCases, DistributedExpandComponentTest, TestSystemIdResolver, VersionInfoTest, ClassificationUpdateProcessorTest, MoreLikeThisHandlerTest, BasicAuthIntegrationTest, ConnectionManagerTest, TestSimpleTrackingShardHandler, TermVectorComponentTest, TestTrackingShardHandlerFactory, SolrCloudExampleTest, SpatialFilterTest, TestStressVersions, TestSchemaNameResource, TestManagedStopFilterFactory, TestReloadAndDeleteDocs, RestartWhileUpdatingTest, OverseerTaskQueueTest, CollectionsAPIDistributedZkTest, ConfigureRecoveryStrategyTest, TestBlobHandler, IndexSchemaRuntimeFieldTest, TestReplicationHandlerBackup, TestScoreJoinQPNoScore, TestPullReplica, TestClusterStateMutator, HighlighterTest, TestCloudPivotFacet, MetricUtilsTest, TestElisionMultitermQuery, TestConfigSetsAPIZkFailure, CurrencyFieldTypeTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TlogReplayBufferedWhileIndexingTest, UpdateRequestProcessorFactoryTest, TestMiniSolrCloudClusterSSL, TestCollectionsAPIViaSolrCloudCluster]
   [junit4] Completed [139/732 (2!)] on J1 in 38.45s, 3 tests, 1 error <<< FAILURES!

[...truncated 1577 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.metrics.reporters.SolrSlf4jReporterTest_81E0D214382D973D-001/init-core-data-001
   [junit4]   2> 2088900 WARN  (SUITE-SolrSlf4jReporterTest-seed#[81

[...truncated too long message...]

ter-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J2-20170823_215752_5068485423811309063233.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-analytics/test/temp/junit4-J0-20170823_215752_5061337150689360345098.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 499 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J2-20170823_215833_64514690628602342521727.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J1-20170823_215833_645256003879301787016.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-clustering/test/temp/junit4-J0-20170823_215833_6457792454856360991953.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 1131 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J1-20170823_215850_3947883679558903710342.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler-extras/test/temp/junit4-J0-20170823_215850_3949066535645536641548.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 590 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J0-20170823_215856_72611246821284006974026.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J2-20170823_215856_72713125470932835221727.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-dataimporthandler/test/temp/junit4-J1-20170823_215856_7277701253502288354244.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 503 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J1-20170823_215919_45311606264767121121668.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J2-20170823_215919_4533124207199727026211.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-cell/test/temp/junit4-J0-20170823_215919_4537399803961897661980.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 507 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J0-20170823_215930_1213691926533887008177.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-langid/test/temp/junit4-J1-20170823_215930_12111361661919332065461.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 592 lines...]
   [junit4] JVM J2: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J2-20170823_215935_88911316777348998480461.syserr
   [junit4] >>> JVM J2 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J2: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J1-20170823_215935_8891078196650118731785.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-ltr/test/temp/junit4-J0-20170823_215935_8895063463079850385620.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 538 lines...]
   [junit4] JVM J1: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J1-20170823_220003_2241259618199657633809.syserr
   [junit4] >>> JVM J1 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J1: EOF ----

[...truncated 3 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-uima/test/temp/junit4-J0-20170823_220003_2243734463741614827998.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 494 lines...]
   [junit4] JVM J0: stderr was not empty, see: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/contrib/solr-velocity/test/temp/junit4-J0-20170823_220012_8682589068091383635953.syserr
   [junit4] >>> JVM J0 emitted unexpected output (verbatim) ----
   [junit4] Java HotSpot(TM) 64-Bit Server VM warning: Option UseConcMarkSweepGC was deprecated in version 9.0 and will likely be removed in a future release.
   [junit4] <<< JVM J0: EOF ----

[...truncated 28972 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20363 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20363/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseG1GC

2 tests failed.
FAILED:  org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader

Error Message:
Doc with id=1 not found in http://127.0.0.1:46583/forceleader_test_collection due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:46583/forceleader_test_collection due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([AF1B0D6875F7EB43:498C39A84C751222]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:556)
	at org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader(ForceLeaderTest.java:142)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:
No 'solr.node' logs in: {numFound=0,start=0,docs=[]}

Stack Trace:
java.lang.AssertionError: No 'solr.node' logs in: {numFound=0,start=0,docs=[]}
	at __randomizedtesting.SeedInfo.seed([AF1B0D6875F7EB43:F0FF205F1EFB7806]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:85)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11162 lines...]
   [junit4] Suite: org.apache.solr.cloud.ForceLeaderTest
   [junit4]   2> 364539 INFO  (SUITE-ForceLeaderTest-seed#[AF1B0D6875F7EB43]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/init-core-data-001
   [junit4]   2> 364539 WARN  (SUITE-ForceLeaderTest-seed#[AF1B0D6875F7EB43]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 364539 INFO  (SUITE-ForceLeaderTest-seed#[AF1B0D6875F7EB43]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 364541 INFO  (SUITE-ForceLeaderTest-seed#[AF1B0D6875F7EB43]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 364541 INFO  (SUITE-ForceLeaderTest-seed#[AF1B0D6875F7EB43]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 364542 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 364542 INFO  (Thread-1134) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 364542 INFO  (Thread-1134) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 364543 ERROR (Thread-1134) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 364642 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.ZkTestServer start zk server on port:45713
   [junit4]   2> 364648 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 364648 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 364649 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 364650 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 364650 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 364651 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 364651 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 364651 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 364652 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 364652 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 364653 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 364653 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 364729 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 364738 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@f733bf{/,null,AVAILABLE}
   [junit4]   2> 364738 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@148748c{HTTP/1.1,[http/1.1]}{127.0.0.1:44631}
   [junit4]   2> 364738 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.Server Started @366327ms
   [junit4]   2> 364738 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/tempDir-001/control/data, hostContext=/, hostPort=33697, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/control-001/cores}
   [junit4]   2> 364739 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 364739 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 364739 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 364739 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 364739 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-23T15:58:59.781Z
   [junit4]   2> 364766 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 364766 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/control-001/solr.xml
   [junit4]   2> 364770 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 364773 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45713/solr
   [junit4]   2> 364818 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:33697_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 364818 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:33697_    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33697_
   [junit4]   2> 364818 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:33697_    ] o.a.s.c.Overseer Overseer (id=98533634184642564-127.0.0.1:33697_-n_0000000000) starting
   [junit4]   2> 364822 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:33697_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33697_
   [junit4]   2> 364822 INFO  (OverseerStateUpdate-98533634184642564-127.0.0.1:33697_-n_0000000000) [n:127.0.0.1:33697_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 364998 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:33697_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 365004 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:33697_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 365004 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:33697_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 365005 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:33697_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/control-001/cores
   [junit4]   2> 365019 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 365019 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45713/solr ready
   [junit4]   2> 365020 INFO  (SocketProxy-Acceptor-33697) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=60742,localport=33697], receiveBufferSize:531000
   [junit4]   2> 365020 INFO  (SocketProxy-Acceptor-33697) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44631,localport=60346], receiveBufferSize=530904
   [junit4]   2> 365020 INFO  (qtp22137960-3779) [n:127.0.0.1:33697_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:33697_&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 365022 INFO  (OverseerThreadFactory-1240-thread-1-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 365125 INFO  (SocketProxy-Acceptor-33697) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=60746,localport=33697], receiveBufferSize:531000
   [junit4]   2> 365125 INFO  (SocketProxy-Acceptor-33697) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44631,localport=60350], receiveBufferSize=530904
   [junit4]   2> 365126 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 365126 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 365232 INFO  (zkCallback-610-thread-1-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 366139 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 366146 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 366226 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 366233 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 366234 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 366234 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 366234 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 366236 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=34.564453125, floorSegmentMB=2.0146484375, forceMergeDeletesPctAllowed=13.950972631492702, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 366237 WARN  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 366272 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 366272 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 366272 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 366272 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 366273 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=50, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 366273 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@b7ad01[control_collection_shard1_replica_n1] main]
   [junit4]   2> 366274 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 366274 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 366275 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 366276 INFO  (searcherExecutor-1243-thread-1-processing-n:127.0.0.1:33697_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@b7ad01[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 366276 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576538148771463168
   [junit4]   2> 366283 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 366283 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 366283 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33697/control_collection_shard1_replica_n1/
   [junit4]   2> 366283 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 366283 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:33697/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 366283 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 366285 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33697/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 366386 INFO  (zkCallback-610-thread-1-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 366436 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 366436 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_ c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1310
   [junit4]   2> 366438 INFO  (qtp22137960-3779) [n:127.0.0.1:33697_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 366538 INFO  (zkCallback-610-thread-1-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 367023 INFO  (OverseerCollectionConfigSetProcessor-98533634184642564-127.0.0.1:33697_-n_0000000000) [n:127.0.0.1:33697_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 367439 INFO  (qtp22137960-3779) [n:127.0.0.1:33697_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:33697_&wt=javabin&version=2} status=0 QTime=2418
   [junit4]   2> 367444 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 367445 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45713/solr ready
   [junit4]   2> 367445 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 367446 INFO  (SocketProxy-Acceptor-33697) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=60760,localport=33697], receiveBufferSize:531000
   [junit4]   2> 367447 INFO  (qtp22137960-3776) [n:127.0.0.1:33697_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 367447 INFO  (SocketProxy-Acceptor-33697) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44631,localport=60364], receiveBufferSize=530904
   [junit4]   2> 367448 INFO  (OverseerThreadFactory-1240-thread-2-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 367448 WARN  (OverseerThreadFactory-1240-thread-2-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 367651 INFO  (qtp22137960-3776) [n:127.0.0.1:33697_    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 367651 INFO  (qtp22137960-3776) [n:127.0.0.1:33697_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=204
   [junit4]   2> 367729 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-1-001 of type TLOG
   [junit4]   2> 367730 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 367731 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b1bb0{/,null,AVAILABLE}
   [junit4]   2> 367731 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@8d11a5{HTTP/1.1,[http/1.1]}{127.0.0.1:40867}
   [junit4]   2> 367731 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.Server Started @369320ms
   [junit4]   2> 367731 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=46583, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-1-001/cores}
   [junit4]   2> 367732 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 367732 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 367732 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 367732 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 367732 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-23T15:59:02.774Z
   [junit4]   2> 367733 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 367734 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-1-001/solr.xml
   [junit4]   2> 367740 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 367743 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45713/solr
   [junit4]   2> 367749 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:46583_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 367750 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:46583_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 367751 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:46583_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46583_
   [junit4]   2> 367752 INFO  (zkCallback-617-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 367752 INFO  (zkCallback-610-thread-2-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 367758 INFO  (zkCallback-622-thread-1-processing-n:127.0.0.1:46583_) [n:127.0.0.1:46583_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 367824 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:46583_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 367832 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:46583_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 367832 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:46583_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 367833 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:46583_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-1-001/cores
   [junit4]   2> 367854 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46583_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 367857 INFO  (OverseerCollectionConfigSetProcessor-98533634184642564-127.0.0.1:33697_-n_0000000000) [n:127.0.0.1:33697_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 367857 INFO  (OverseerThreadFactory-1240-thread-3-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:46583_ for creating new replica
   [junit4]   2> 367858 INFO  (SocketProxy-Acceptor-46583) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=45074,localport=46583], receiveBufferSize:531000
   [junit4]   2> 367862 INFO  (SocketProxy-Acceptor-46583) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=40867,localport=57820], receiveBufferSize=530904
   [junit4]   2> 367878 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 367878 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 368897 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 368908 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
   [junit4]   2> 368994 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 369001 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
   [junit4]   2> 369002 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 369002 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 369002 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
   [junit4]   2> 369004 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=34.564453125, floorSegmentMB=2.0146484375, forceMergeDeletesPctAllowed=13.950972631492702, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 369006 WARN  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 369031 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 369031 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 369032 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 369032 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 369033 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=50, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 369033 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@1e35521[collection1_shard2_replica_t41] main]
   [junit4]   2> 369034 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 369034 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 369035 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 369035 INFO  (searcherExecutor-1254-thread-1-processing-n:127.0.0.1:46583_ x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@1e35521[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 369035 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576538151664484352
   [junit4]   2> 369038 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 369038 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 369038 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46583/collection1_shard2_replica_t41/
   [junit4]   2> 369038 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 369038 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:46583/collection1_shard2_replica_t41/ has no replicas
   [junit4]   2> 369038 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 369038 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
   [junit4]   2> 369039 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46583/collection1_shard2_replica_t41/ shard2
   [junit4]   2> 369199 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 369211 INFO  (qtp12268846-3827) [n:127.0.0.1:46583_ c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1333
   [junit4]   2> 369212 INFO  (qtp22137960-3775) [n:127.0.0.1:33697_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46583_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1357
   [junit4]   2> 369277 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-2-001 of type TLOG
   [junit4]   2> 369277 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 369278 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@f6649a{/,null,AVAILABLE}
   [junit4]   2> 369279 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@179bfa7{HTTP/1.1,[http/1.1]}{127.0.0.1:33627}
   [junit4]   2> 369279 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.Server Started @370868ms
   [junit4]   2> 369279 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=41835, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-2-001/cores}
   [junit4]   2> 369279 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 369280 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 369280 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 369280 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 369280 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-23T15:59:04.322Z
   [junit4]   2> 369283 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 369283 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-2-001/solr.xml
   [junit4]   2> 369286 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 369288 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45713/solr
   [junit4]   2> 369292 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:41835_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 369293 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:41835_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 369293 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:41835_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41835_
   [junit4]   2> 369294 INFO  (zkCallback-617-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 369294 INFO  (zkCallback-610-thread-1-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 369294 INFO  (zkCallback-628-thread-1-processing-n:127.0.0.1:41835_) [n:127.0.0.1:41835_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 369294 INFO  (zkCallback-622-thread-1-processing-n:127.0.0.1:46583_) [n:127.0.0.1:46583_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 369375 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:41835_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 369383 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:41835_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 369383 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:41835_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 369384 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:41835_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-2-001/cores
   [junit4]   2> 369409 INFO  (SocketProxy-Acceptor-41835) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49476,localport=41835], receiveBufferSize:531000
   [junit4]   2> 369409 INFO  (SocketProxy-Acceptor-41835) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=33627,localport=59492], receiveBufferSize=530904
   [junit4]   2> 369409 INFO  (qtp20612266-3860) [n:127.0.0.1:41835_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:41835_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 369410 INFO  (OverseerCollectionConfigSetProcessor-98533634184642564-127.0.0.1:33697_-n_0000000000) [n:127.0.0.1:33697_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 369414 INFO  (OverseerThreadFactory-1240-thread-4-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:41835_ for creating new replica
   [junit4]   2> 369415 INFO  (SocketProxy-Acceptor-41835) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49480,localport=41835], receiveBufferSize:531000
   [junit4]   2> 369416 INFO  (SocketProxy-Acceptor-41835) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=33627,localport=59496], receiveBufferSize=530904
   [junit4]   2> 369416 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 369416 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 370426 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 370434 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
   [junit4]   2> 370496 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 370503 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
   [junit4]   2> 370503 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 370503 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 370503 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
   [junit4]   2> 370505 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=34.564453125, floorSegmentMB=2.0146484375, forceMergeDeletesPctAllowed=13.950972631492702, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 370507 WARN  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 370533 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 370533 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 370534 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 370534 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 370535 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=50, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 370535 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@14fab6e[collection1_shard1_replica_t43] main]
   [junit4]   2> 370536 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 370536 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 370536 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 370537 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576538153239445504
   [junit4]   2> 370537 INFO  (searcherExecutor-1265-thread-1-processing-n:127.0.0.1:41835_ x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@14fab6e[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 370539 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 370539 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 370540 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41835/collection1_shard1_replica_t43/
   [junit4]   2> 370540 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 370540 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:41835/collection1_shard1_replica_t43/ has no replicas
   [junit4]   2> 370540 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 370540 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
   [junit4]   2> 370541 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41835/collection1_shard1_replica_t43/ shard1
   [junit4]   2> 370692 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 370693 INFO  (qtp20612266-3862) [n:127.0.0.1:41835_ c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1276
   [junit4]   2> 370694 INFO  (qtp20612266-3860) [n:127.0.0.1:41835_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:41835_&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1284
   [junit4]   2> 370755 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-3-001 of type TLOG
   [junit4]   2> 370755 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 370756 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2e9782{/,null,AVAILABLE}
   [junit4]   2> 370756 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@73841d{HTTP/1.1,[http/1.1]}{127.0.0.1:43865}
   [junit4]   2> 370756 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.e.j.s.Server Started @372345ms
   [junit4]   2> 370756 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/, hostPort=43389, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-3-001/cores}
   [junit4]   2> 370757 ERROR (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 370757 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 370757 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 370757 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 370757 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-23T15:59:05.799Z
   [junit4]   2> 370759 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 370759 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-3-001/solr.xml
   [junit4]   2> 370762 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 370764 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45713/solr
   [junit4]   2> 370768 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:43389_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 370769 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:43389_    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 370770 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:43389_    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43389_
   [junit4]   2> 370770 INFO  (zkCallback-617-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 370771 INFO  (zkCallback-622-thread-1-processing-n:127.0.0.1:46583_) [n:127.0.0.1:46583_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 370771 INFO  (zkCallback-628-thread-1-processing-n:127.0.0.1:41835_) [n:127.0.0.1:41835_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 370771 INFO  (zkCallback-610-thread-1-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 370774 INFO  (zkCallback-634-thread-1-processing-n:127.0.0.1:43389_) [n:127.0.0.1:43389_    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 370840 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:43389_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 370847 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:43389_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 370847 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:43389_    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 370848 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [n:127.0.0.1:43389_    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-3-001/cores
   [junit4]   2> 370881 INFO  (SocketProxy-Acceptor-43389) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=50128,localport=43389], receiveBufferSize:531000
   [junit4]   2> 370882 INFO  (SocketProxy-Acceptor-43389) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=43865,localport=41480], receiveBufferSize=530904
   [junit4]   2> 370886 INFO  (qtp11269824-3894) [n:127.0.0.1:43389_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:43389_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 370887 INFO  (OverseerCollectionConfigSetProcessor-98533634184642564-127.0.0.1:33697_-n_0000000000) [n:127.0.0.1:33697_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 370887 INFO  (OverseerThreadFactory-1240-thread-5-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:43389_ for creating new replica
   [junit4]   2> 370888 INFO  (SocketProxy-Acceptor-43389) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=50132,localport=43389], receiveBufferSize:531000
   [junit4]   2> 370889 INFO  (SocketProxy-Acceptor-43389) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=43865,localport=41484], receiveBufferSize=530904
   [junit4]   2> 370889 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 370889 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 371903 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 371911 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
   [junit4]   2> 371977 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 371990 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
   [junit4]   2> 371990 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1718c21
   [junit4]   2> 371990 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 371990 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
   [junit4]   2> 371993 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=42, maxMergeAtOnceExplicit=46, maxMergedSegmentMB=34.564453125, floorSegmentMB=2.0146484375, forceMergeDeletesPctAllowed=13.950972631492702, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 371995 WARN  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 372027 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 372027 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 372028 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 372028 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 372029 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=50, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 372029 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@a49760[collection1_shard2_replica_t45] main]
   [junit4]   2> 372030 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 372030 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 372030 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 372031 INFO  (searcherExecutor-1276-thread-1-processing-n:127.0.0.1:43389_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@a49760[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 372031 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576538154806018048
   [junit4]   2> 372033 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
   [junit4]   2> 372033 INFO  (updateExecutor-631-thread-1-processing-n:127.0.0.1:43389_ x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:43389_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 372033 INFO  (qtp11269824-3890) [n:127.0.0.1:43389_ c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1144
   [junit4]   2> 372033 INFO  (recoveryExecutor-632-thread-1-processing-n:127.0.0.1:43389_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:43389_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 372034 INFO  (recoveryExecutor-632-thread-1-processing-n:127.0.0.1:43389_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:43389_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 372034 INFO  (recoveryExecutor-632-thread-1-processing-n:127.0.0.1:43389_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:43389_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
   [junit4]   2> 372034 INFO  (recoveryExecutor-632-thread-1-processing-n:127.0.0.1:43389_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:43389_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
   [junit4]   2> 372034 INFO  (recoveryExecutor-632-thread-1-processing-n:127.0.0.1:43389_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:43389_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 372034 INFO  (recoveryExecutor-632-thread-1-processing-n:127.0.0.1:43389_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:43389_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:46583/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:43389/collection1_shard2_replica_t45/]
   [junit4]   2> 372035 INFO  (qtp11269824-3894) [n:127.0.0.1:43389_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:43389_&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1149
   [junit4]   2> 372037 INFO  (recoveryExecutor-632-thread-1-processing-n:127.0.0.1:43389_ x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:43389_ c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:46583]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:43389_&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 372037 INFO  (SocketProxy-Acceptor-46583) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=45112,localport=46583], receiveBufferSize:531000
   [junit4]   2> 372037 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testReplicasInLIRNoLeader
   [junit4]   2> 372037 INFO  (SocketProxy-Acceptor-46583) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=40867,localport=57858], receiveBufferSize=530904
   [junit4]   2> 372037 INFO  (TEST-ForceLeaderTest.testReplicasInLIRNoLeader-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Creating collection with stateFormat=1: forceleader_test_collection
   [junit4]   2> 372038 INFO  (qtp12268846-3823) [n:127.0.0.1:46583_    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 372038 INFO  (qtp12268846-3823) [n:127.0.0.1:46583_    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:43389_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:43389","node_name":"127.0.0.1:43389_","state":"down","type":"TLOG"}
   [junit4]   2> 372043 INFO  (SocketProxy-Acceptor-41835) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49508,localport=41835], receiveBufferSize:531000
   [junit4]   2> 372043 INFO  (SocketProxy-Acceptor-41835) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=33627,localport=59524], receiveBufferSize=530904
   [junit4]   2> 372043 INFO  (qtp20612266-3856) [n:127.0.0.1:41835_    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&maxShardsPerNode=1&collection.configName=conf1&nrtReplicas=0&name=forceleader_test_collection&action=CREATE&numShards=1&tlogReplicas=3&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 372044 INFO  (OverseerThreadFactory-1240-thread-5-processing-n:127.0.0.1:33697_) [n:127.0.0.1:33697_    ] o.a.s.c.CreateCollectionCmd Create collection forceleader_test_collection
   [junit4]   2> 372044 INFO  (OverseerCollectionConfigSetProcessor-98533634184642564-127.0.0.1:33697_-n_0000000000) [n:127.0.0.1:33697_    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 372248 INFO  (qtp12268846-3828) [n:127.0.0.1:46583_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=forceleader_test_collection_shard1_replica_t1&action=CREATE&numShards=1&collection=forceleader_test_collection&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 372248 INFO  (qtp11269824-3896) [n:127.0.0.1:43389_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=forceleader_test_collection_shard1_replica_t2&action=CREATE&numShards=1&collection=forceleader_test_collection&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 372249 INFO  (qtp20612266-3855) [n:127.0.0.1:41835_    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=forceleader_test_collection_shard1_replica_t3&action=CREATE&numShards=1&collection=forceleader_test_collection&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 373038 INFO  (qtp12268846-3823) [n:127.0.0.1:46583_    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:43389_, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:43389","node_name":"127.0.0.1:43389_","state":"recovering","type":"TLOG"}
   [junit4]   2> 373038 INFO  (qtp12268846-3823) [n:127.0.0.1:46583_    ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
   [junit4]   2> 373038 INFO  (qtp12268846-3823) [n:127.0.0.1:46583_    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:43389_&onlyIfLeaderActive=true&core=collection1_shard2_replica_t41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1000
   [junit4]   2> 373265 INFO  (qtp12268846-3828) [n:127.0.0.1:46583_ c:forceleader_test_collection s:shard1  x:forceleader_test_collection_shard1_replica_t1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 373265 INFO  (qtp20612266-3855) [n:127.0.0.1:41835_ c:forceleader_test_collection s:shard1  x:forceleader_test_collection_shard1_replica_t3] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 373266 INFO  (qtp11269824-3896) [n:127.0.0.1:43389_ c:forceleader_test_collection s:shard1  x:forceleader_test_collection_shard1_replica_t2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 373297 INFO  (qtp20612266-3855) [n:127.0.0.1:41835_ c:forceleader_test_collection s:shard1  x:forceleader_test_collection_shard1_replica_t3] o.a.s.s.IndexSchema [forceleader_test_collection_shard1_replica_t3] Schema name=test
   [junit4]   2> 373298 INFO  (qtp12268846-3828) [n:127.0.0.1:46583_ c:forceleader_test_collection s:shard1  x:forceleader_test_collection_shard1_replica_t1] o.a.s.s.IndexSchema [forceleader_test_collection_shard1_replica_t1] Schema name=test
   [junit4]   2> 373299 INFO  (qtp11269824-3896) [n:127.0.0.1:43389_ c:forceleader_test_collection s:shard1  x:forceleader_test_collection_shard1_replica_t2] o.a.s.s.IndexSchema [forceleader_test_collection_shard1_replica_t2] Schema name=test
   [junit4]   2> 373365 INFO  (qtp20612266-3855) [n:127.0.0.1:41835_ c:forceleader_test_collection s:shard1  x:forceleader_test_collection_shard1_replica_t3] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 373370 INFO  (qtp12268846-3828) [n:127.0.0.1:46583_ c:forceleader_test_collection s:shard1  x:forceleader_test_collection_shard1_replica_t1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid fi

[...truncated too long message...]

d59a3{/,null,UNAVAILABLE}
   [junit4]   2> 466577 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.ChaosMonkey monkey: stop jetty! 46453
   [junit4]   2> 466577 ERROR (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[AF1B0D6875F7EB43]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 466577 INFO  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41345 41345
   [junit4]   2> 471616 INFO  (Thread-1177) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:41345 41345
   [junit4]   2> 471616 WARN  (Thread-1177) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 	3	/solr/collections/forceleader_last_published/state.json
   [junit4]   2> 	3	/solr/collections/collection1/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/collections/forceleader_last_published/leader_elect/shard1/election/98533636747755524-core_node6-n_0000000000
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	4	/solr/overseer/queue
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 471617 WARN  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SocketProxy Closing 2 connections to: http://127.0.0.1:34245/, target: http://127.0.0.1:37745/
   [junit4]   2> 471617 WARN  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SocketProxy Closing 4 connections to: http://127.0.0.1:46453/, target: http://127.0.0.1:45271/
   [junit4]   2> 471617 WARN  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SocketProxy Closing 8 connections to: http://127.0.0.1:34723/, target: http://127.0.0.1:33245/
   [junit4]   2> 471617 WARN  (TEST-ForceLeaderTest.testLastPublishedStateIsActive-seed#[AF1B0D6875F7EB43]) [    ] o.a.s.c.SocketProxy Closing 4 connections to: http://127.0.0.1:36905/, target: http://127.0.0.1:46697/
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.ForceLeaderTest_AF1B0D6875F7EB43-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {multiDefault=BlockTreeOrds(blocksize=128), a_t=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), id=PostingsFormat(name=LuceneVarGapDocFreqInterval), text=PostingsFormat(name=Asserting)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Asserting), intDvoDefault=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Asserting)}, maxPointsInLeafNode=1423, maxMBSortInHeap=7.279120438501033, sim=RandomSimilarity(queryNorm=true): {}, locale=zh, timezone=Africa/Malabo
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=106097056,total=466616320
   [junit4]   2> NOTE: All tests run in this JVM: [BadCopyFieldTest, SliceStateTest, ZkControllerTest, ClusterStateUpdateTest, TestRTGBase, TestSubQueryTransformerDistrib, LargeFieldTest, QueryParsingTest, TestNumericTokenStream, LukeRequestHandlerTest, VersionInfoTest, V2StandaloneTest, LeaderInitiatedRecoveryOnCommitTest, ClassificationUpdateProcessorTest, TestFieldCacheVsDocValues, ZkSolrClientTest, ConnectionReuseTest, SubstringBytesRefFilterTest, TestBM25SimilarityFactory, LeaderElectionContextKeyTest, MoreLikeThisHandlerTest, RemoteQueryErrorTest, ResourceLoaderTest, TestSolrCloudWithDelegationTokens, ConfigureRecoveryStrategyTest, TestAuthorizationFramework, TestElisionMultitermQuery, TestHdfsCloudBackupRestore, TestDistributedGrouping, TestSolrCoreSnapshots, TestAnalyzeInfixSuggestions, DataDrivenBlockJoinTest, UpdateRequestProcessorFactoryTest, TestSolrIndexConfig, DistributedQueueTest, TestConfigSetsAPIZkFailure, TestSolrJ, OverseerModifyCollectionTest, BadComponentTest, DistributedExpandComponentTest, TestSolrConfigHandlerConcurrent, TestFreeTextSuggestions, HdfsUnloadDistributedZkTest, AlternateDirectoryTest, ResponseHeaderTest, DistanceFunctionTest, TestCloudDeleteByQuery, TestComplexPhraseLeadingWildcard, ForceLeaderTest]
   [junit4] Completed [140/732 (1!)] on J1 in 107.10s, 3 tests, 1 failure, 1 skipped <<< FAILURES!

[...truncated 731 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_AF1B0D6875F7EB43-001/init-core-data-001
   [junit4]   2> 1282812 WARN  (SUITE-SolrSlf4jReporterTest-seed#[AF1B0D6875F7EB43]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=AF1B0D6875F7EB43 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ar -Dtests.timezone=America/Nassau -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 6.27s J1 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: No 'solr.node' logs in: {numFound=0,start=0,docs=[]}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([AF1B0D6875F7EB43:F0FF205F1EFB7806]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:85)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.metrics.reporters.SolrSlf4jReporterTest_AF1B0D6875F7EB43-001
   [junit4]   2> NOTE: test params are: codec=DummyCompressingStoredFields(storedFieldsFormat=CompressingStoredFieldsFormat(compressionMode=DUMMY, chunkSize=13607, maxDocsPerChunk=6, blockSize=860), termVectorsFormat=CompressingTermVectorsFormat(compressionMode=DUMMY, chunkSize=13607, blockSize=860)), sim=RandomSimilarity(queryNorm=true): {}, locale=ar, timezone=America/Nassau
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=295474496,total=536870912
   [junit4]   2> NOTE: All tests run in this JVM: [BadCopyFieldTest, SliceStateTest, ZkControllerTest, ClusterStateUpdateTest, TestRTGBase, TestSubQueryTransformerDistrib, LargeFieldTest, QueryParsingTest, TestNumericTokenStream, LukeRequestHandlerTest, VersionInfoTest, V2StandaloneTest, LeaderInitiatedRecoveryOnCommitTest, ClassificationUpdateProcessorTest, TestFieldCacheVsDocValues, ZkSolrClientTest, ConnectionReuseTest, SubstringBytesRefFilterTest, TestBM25SimilarityFactory, LeaderElectionContextKeyTest, MoreLikeThisHandlerTest, RemoteQueryErrorTest, ResourceLoaderTest, TestSolrCloudWithDelegationTokens, ConfigureRecoveryStrategyTest, TestAuthorizationFramework, TestElisionMultitermQuery, TestHdfsCloudBackupRestore, TestDistributedGrouping, TestSolrCoreSnapshots, TestAnalyzeInfixSuggestions, DataDrivenBlockJoinTest, UpdateRequestProcessorFactoryTest, TestSolrIndexConfig, DistributedQueueTest, TestConfigSetsAPIZkFailure, TestSolrJ, OverseerModifyCollectionTest, BadComponentTest, DistributedExpandComponentTest, TestSolrConfigHandlerConcurrent, TestFreeTextSuggestions, HdfsUnloadDistributedZkTest, AlternateDirectoryTest, ResponseHeaderTest, DistanceFunctionTest, TestCloudDeleteByQuery, TestComplexPhraseLeadingWildcard, ForceLeaderTest, OverseerTaskQueueTest, DOMUtilTest, OpenCloseCoreStressTest, SampleTest, DocValuesTest, CSVRequestHandlerTest, AnalysisAfterCoreReloadTest, HdfsSyncSliceTest, TestTrackingShardHandlerFactory, TestDocBasedVersionConstraints, TestFiltering, WrapperMergePolicyFactoryTest, TestManagedStopFilterFactory, TestPullReplica, TestJsonFacetRefinement, AnalyticsMergeStrategyTest, TlogReplayBufferedWhileIndexingTest, TestSQLHandler, DistributedTermsComponentTest, TestCoreContainer, TestNumericTerms32, CdcrReplicationHandlerTest, TestExpandComponent, CollectionStateFormat2Test, TestGraphMLResponseWriter, TestHashQParserPlugin, TestConfigSetProperties, TestMaxScoreQueryParser, GraphQueryTest, AssignBackwardCompatibilityTest, TestSmileRequest, HdfsChaosMonkeySafeLeaderTest, TestSolrCLIRunExample, TestCloudPivotFacet, TestOrdValues, SystemInfoHandlerTest, MissingSegmentRecoveryTest, DistributedIntervalFacetingTest, CacheHeaderTest, DirectSolrConnectionTest, AtomicUpdatesTest, TestPostingsSolrHighlighter, DeleteInactiveReplicaTest, TestPerFieldSimilarity, IndexSchemaRuntimeFieldTest, TestScoreJoinQPNoScore, CollectionsAPIDistributedZkTest, CoreMergeIndexesAdminHandlerTest, TestCursorMarkWithoutUniqueKey, ConnectionManagerTest, TestLeaderInitiatedRecoveryThread, TestMultiValuedNumericRangeQuery, SharedFSAutoReplicaFailoverUtilsTest, TestReplicationHandlerBackup, TestCoreDiscovery, TestAtomicUpdateErrorCases, TestStreamBody, FileBasedSpellCheckerTest, MetricsConfigTest, TestCustomDocTransformer, MetricUtilsTest, TestBlobHandler, SoftAutoCommitTest, TestLegacyFieldReuse, TestSolrFieldCacheBean, TestInPlaceUpdatesDistrib, TestEmbeddedSolrServerConstructors, SolrSlf4jReporterTest]
   [junit4] Completed [353/732 (2!)] on J1 in 6.30s, 1 test, 1 failure <<< FAILURES!

[...truncated 40655 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20362 - Still Failing!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20362/
Java: 64bit/jdk1.8.0_144 -XX:-UseCompressedOops -XX:+UseConcMarkSweepGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation

Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:     1) Thread[id=10782, name=jetty-launcher-1401-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)    2) Thread[id=10792, name=jetty-launcher-1401-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   1) Thread[id=10782, name=jetty-launcher-1401-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   2) Thread[id=10792, name=jetty-launcher-1401-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
        at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
        at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
        at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
        at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
        at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
        at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
        at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
        at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
        at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
	at __randomizedtesting.SeedInfo.seed([DDD9A826DE34A0B3]:0)


FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Doc with id=1 not found in http://127.0.0.1:44893/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:44893/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([DDD9A826DE34A0B3:558D97FC70C8CD4B]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11636 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DDD9A826DE34A0B3-001/init-core-data-001
   [junit4]   2> 970855 WARN  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DDD9A826DE34A0B3]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=93 numCloses=93
   [junit4]   2> 970855 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DDD9A826DE34A0B3]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 970856 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DDD9A826DE34A0B3]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 970857 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DDD9A826DE34A0B3]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 970870 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DDD9A826DE34A0B3]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DDD9A826DE34A0B3-001/tempDir-001
   [junit4]   2> 970871 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DDD9A826DE34A0B3]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 970871 INFO  (Thread-4467) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 970871 INFO  (Thread-4467) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 970873 ERROR (Thread-4467) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 970971 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DDD9A826DE34A0B3]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:45293
   [junit4]   2> 970975 INFO  (jetty-launcher-1401-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 970975 INFO  (jetty-launcher-1401-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 970985 INFO  (jetty-launcher-1401-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@f121dc5{/solr,null,AVAILABLE}
   [junit4]   2> 970987 INFO  (jetty-launcher-1401-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b3880f6{/solr,null,AVAILABLE}
   [junit4]   2> 970987 INFO  (jetty-launcher-1401-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@461e4cda{SSL,[ssl, http/1.1]}{127.0.0.1:45311}
   [junit4]   2> 970988 INFO  (jetty-launcher-1401-thread-1) [    ] o.e.j.s.Server Started @972643ms
   [junit4]   2> 970988 INFO  (jetty-launcher-1401-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45311}
   [junit4]   2> 970988 ERROR (jetty-launcher-1401-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 970988 INFO  (jetty-launcher-1401-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 970988 INFO  (jetty-launcher-1401-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 970988 INFO  (jetty-launcher-1401-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 970988 INFO  (jetty-launcher-1401-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-23T10:05:43.853Z
   [junit4]   2> 970988 INFO  (jetty-launcher-1401-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@24cf6837{SSL,[ssl, http/1.1]}{127.0.0.1:41587}
   [junit4]   2> 970988 INFO  (jetty-launcher-1401-thread-2) [    ] o.e.j.s.Server Started @972644ms
   [junit4]   2> 970988 INFO  (jetty-launcher-1401-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=41587}
   [junit4]   2> 970988 ERROR (jetty-launcher-1401-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 970988 INFO  (jetty-launcher-1401-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 970989 INFO  (jetty-launcher-1401-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 970989 INFO  (jetty-launcher-1401-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 970989 INFO  (jetty-launcher-1401-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-23T10:05:43.854Z
   [junit4]   2> 970992 INFO  (jetty-launcher-1401-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 970992 INFO  (jetty-launcher-1401-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 970995 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e0e8e0bb90002, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 971003 INFO  (jetty-launcher-1401-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45293/solr
   [junit4]   2> 971004 INFO  (jetty-launcher-1401-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:45293/solr
   [junit4]   2> 971029 INFO  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 971029 INFO  (jetty-launcher-1401-thread-2) [n:127.0.0.1:41587_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 971030 INFO  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45311_solr
   [junit4]   2> 971030 INFO  (jetty-launcher-1401-thread-2) [n:127.0.0.1:41587_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41587_solr
   [junit4]   2> 971030 INFO  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.c.Overseer Overseer (id=98532245093548037-127.0.0.1:45311_solr-n_0000000000) starting
   [junit4]   2> 971031 INFO  (zkCallback-1413-thread-1-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 971037 INFO  (zkCallback-1412-thread-1-processing-n:127.0.0.1:45311_solr) [n:127.0.0.1:45311_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 971038 INFO  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45311_solr
   [junit4]   2> 971039 INFO  (zkCallback-1412-thread-1-processing-n:127.0.0.1:45311_solr) [n:127.0.0.1:45311_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 971039 INFO  (zkCallback-1413-thread-1-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 971055 INFO  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 971059 WARN  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 971060 INFO  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
   [junit4]   2> 971063 INFO  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 971067 INFO  (jetty-launcher-1401-thread-1-EventThread) [n:127.0.0.1:45311_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 971083 WARN  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 971117 INFO  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45311.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21d185c1
   [junit4]   2> 971124 INFO  (jetty-launcher-1401-thread-2) [n:127.0.0.1:41587_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 971124 WARN  (jetty-launcher-1401-thread-2) [n:127.0.0.1:41587_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 971124 INFO  (jetty-launcher-1401-thread-2) [n:127.0.0.1:41587_solr    ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
   [junit4]   2> 971125 INFO  (jetty-launcher-1401-thread-2) [n:127.0.0.1:41587_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 971125 INFO  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45311.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21d185c1
   [junit4]   2> 971125 INFO  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45311.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21d185c1
   [junit4]   2> 971126 INFO  (jetty-launcher-1401-thread-1) [n:127.0.0.1:45311_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DDD9A826DE34A0B3-001/tempDir-001/node1/.
   [junit4]   2> 971128 INFO  (jetty-launcher-1401-thread-2-EventThread) [n:127.0.0.1:41587_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 972140 WARN  (jetty-launcher-1401-thread-2) [n:127.0.0.1:41587_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 972178 INFO  (jetty-launcher-1401-thread-2) [n:127.0.0.1:41587_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41587.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21d185c1
   [junit4]   2> 972185 INFO  (jetty-launcher-1401-thread-2) [n:127.0.0.1:41587_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41587.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21d185c1
   [junit4]   2> 972185 INFO  (jetty-launcher-1401-thread-2) [n:127.0.0.1:41587_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41587.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21d185c1
   [junit4]   2> 972186 INFO  (jetty-launcher-1401-thread-2) [n:127.0.0.1:41587_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DDD9A826DE34A0B3-001/tempDir-001/node2/.
   [junit4]   2> 972223 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
   [junit4]   2> 973571 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=test&e=1503518745126&s=LWqBsDSZdDUkCDNOO/0GvO9W4V0="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:45 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:45 GMT
   [junit4]   2> 973572 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
   [junit4]   2> 973590 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
   [junit4]   2> 973591 INFO  (qtp204551648-10746) [n:127.0.0.1:45311_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 973591 INFO  (qtp204551648-10746) [n:127.0.0.1:45311_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 973592 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=test&e=1503518746456&s=e0YeYIUsEtxPYyLOjP02RFtRHBE="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:46 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:46 GMT
   [junit4]   2> 973592 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
   [junit4]   2> 973599 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
   [junit4]   2> 973601 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=test&e=1503518746464&s=apnfoPMFnb1Y62X4tHdw7Lp6hD0="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:46 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:46 GMT
   [junit4]   2> 973601 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
   [junit4]   2> 973608 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
   [junit4]   2> 973608 INFO  (qtp204551648-10749) [n:127.0.0.1:45311_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 973608 INFO  (qtp204551648-10749) [n:127.0.0.1:45311_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 973609 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1503518746473&s=10M20GTjx4DEUxDPK+njfAShl0g="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:46 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:46 GMT
   [junit4]   2> 973609 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
   [junit4]   2> 973616 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
   [junit4]   2> 973620 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1503518746481&s=mw/VlMp4qkARLHqMNDGDQhcOUiE="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:46 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:46 GMT
   [junit4]   2> 973620 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
   [junit4]   2> 973628 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
   [junit4]   2> 973717 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 973717 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:45293/solr ready
   [junit4]   2> 973719 INFO  (qtp204551648-10749) [n:127.0.0.1:45311_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 973720 INFO  (OverseerThreadFactory-3439-thread-1-processing-n:127.0.0.1:45311_solr) [n:127.0.0.1:45311_solr    ] o.a.s.c.CreateCollectionCmd Create collection forwardingCollection
   [junit4]   2> 973824 INFO  (OverseerStateUpdate-98532245093548037-127.0.0.1:45311_solr-n_0000000000) [n:127.0.0.1:45311_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"forwardingCollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"forwardingCollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"https://127.0.0.1:41587/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 974063 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 974063 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 974168 INFO  (zkCallback-1413-thread-1-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 974169 INFO  (zkCallback-1413-thread-2-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 975086 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 975109 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
   [junit4]   2> 975166 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 975174 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
   [junit4]   2> 975174 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_41587.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@21d185c1
   [junit4]   2> 975174 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 975174 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DDD9A826DE34A0B3-001/tempDir-001/node2/forwardingCollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_DDD9A826DE34A0B3-001/tempDir-001/node2/./forwardingCollection_shard1_replica_n1/data/]
   [junit4]   2> 975176 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=12, maxMergeAtOnceExplicit=26, maxMergedSegmentMB=26.8291015625, floorSegmentMB=0.3525390625, forceMergeDeletesPctAllowed=11.984694190231295, segmentsPerTier=27.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.22427659088675764
   [junit4]   2> 975206 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 975206 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 975207 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 975207 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 975207 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=35, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.5012619800574343]
   [junit4]   2> 975207 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1f65255[forwardingCollection_shard1_replica_n1] main]
   [junit4]   2> 975209 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 975232 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 975286 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 975286 INFO  (searcherExecutor-3444-thread-1-processing-n:127.0.0.1:41587_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 975286 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576515926125182976
   [junit4]   2> 975287 INFO  (searcherExecutor-3444-thread-1-processing-n:127.0.0.1:41587_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 975287 INFO  (searcherExecutor-3444-thread-1-processing-n:127.0.0.1:41587_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 975287 INFO  (searcherExecutor-3444-thread-1-processing-n:127.0.0.1:41587_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 975287 INFO  (searcherExecutor-3444-thread-1-processing-n:127.0.0.1:41587_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 975287 INFO  (searcherExecutor-3444-thread-1-processing-n:127.0.0.1:41587_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 975288 INFO  (searcherExecutor-3444-thread-1-processing-n:127.0.0.1:41587_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 975288 INFO  (searcherExecutor-3444-thread-1-processing-n:127.0.0.1:41587_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 975288 INFO  (searcherExecutor-3444-thread-1-processing-n:127.0.0.1:41587_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 975289 INFO  (searcherExecutor-3444-thread-1-processing-n:127.0.0.1:41587_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@1f65255[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 975296 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 975296 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 975296 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to https://127.0.0.1:41587/solr/forwardingCollection_shard1_replica_n1/
   [junit4]   2> 975296 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 975296 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy https://127.0.0.1:41587/solr/forwardingCollection_shard1_replica_n1/ has no replicas
   [junit4]   2> 975296 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 975298 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: https://127.0.0.1:41587/solr/forwardingCollection_shard1_replica_n1/ shard1
   [junit4]   2> 975401 INFO  (zkCallback-1413-thread-1-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 975401 INFO  (zkCallback-1413-thread-2-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 975449 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 975451 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1388
   [junit4]   2> 975452 WARN  (httpShardExecutor-3436-thread-1-processing-n:127.0.0.1:45311_solr [https:////127.0.0.1:41587//solr] https:////127.0.0.1:41587//solr) [n:127.0.0.1:45311_solr    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1503518746927&s=BfienrJzQgREIY9d9nLJolExMUs="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:46 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:46 GMT
   [junit4]   2> 975454 INFO  (qtp204551648-10749) [n:127.0.0.1:45311_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 975554 INFO  (zkCallback-1413-thread-2-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 975554 INFO  (zkCallback-1413-thread-1-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 975721 INFO  (OverseerCollectionConfigSetProcessor-98532245093548037-127.0.0.1:45311_solr-n_0000000000) [n:127.0.0.1:45311_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 976455 INFO  (qtp204551648-10749) [n:127.0.0.1:45311_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=2735
   [junit4]   2> 976455 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1503518746584&s=++ZC0tjn7RutWVsoLevwl27m10M="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:46 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:46 GMT
   [junit4]   2> 976456 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
   [junit4]   2> 976456 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
   [junit4]   2> 976460 INFO  (qtp204551648-10747) [n:127.0.0.1:45311_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 976466 INFO  (qtp1016239370-10737) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 976466 WARN  (qtp204551648-10747) [n:127.0.0.1:45311_solr    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1503518749330&s=L8pIEKb5C8DWDOZlg6qgg4Yh46A="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:49 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:49 GMT
   [junit4]   2> 976467 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1503518749325&s=1/B4yxgJUsxsOEj5kujjyI6VR0w="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:49 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:49 GMT
   [junit4]   2> 976468 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1503518749330&s=L8pIEKb5C8DWDOZlg6qgg4Yh46A="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:49 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:49 GMT
   [junit4]   2> 976473 INFO  (qtp1016239370-10752) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 976474 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1503518749337&s=yT2D24No0U2nbhcjpmQxWVixH3A="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:49 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:49 GMT
   [junit4]   2> 976474 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
   [junit4]   2> 976500 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
   [junit4]   2> 976503 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=test&e=1503518749366&s=aC3puNwn55wW4yTHtypwfm0yTJo="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:49 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:49 GMT
   [junit4]   2> 976503 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
   [junit4]   2> 976523 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
   [junit4]   2> 976524 INFO  (qtp204551648-10747) [n:127.0.0.1:45311_solr    ] o.a.s.s.SolrDispatchFilter Error authenticating
   [junit4]   2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 976525 WARN  (qtp204551648-10747) [n:127.0.0.1:45311_solr    ] o.e.j.s.ServletHandler /solr/admin/collections
   [junit4]   2> org.apache.solr.common.SolrException: Error during request authentication, 
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:457)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:347)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1759)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:582)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:224)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1180)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:512)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1112)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:493)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:134)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:534)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:320)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.ssl.SslConnection.onFillable(SslConnection.java:251)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:283)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:108)
   [junit4]   2> 	at org.eclipse.jetty.io.SelectChannelEndPoint$2.run(SelectChannelEndPoint.java:93)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:303)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.run(ExecuteProduceConsume.java:136)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:451)
   [junit4]   2> 	... 29 more
   [junit4]   2> 976526 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
   [junit4]   2> 976544 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
   [junit4]   2> 976548 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=test&e=1503518749411&s=UlfKKL1BUodgc3KohPVqZ7KDM4o="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:49 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:49 GMT
   [junit4]   2> 976548 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
   [junit4]   2> 976565 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
   [junit4]   2> 988905 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[DDD9A826DE34A0B3]-SendThread(127.0.0.1:45293)) [    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 12449ms for sessionid 0x15e0e8e0bb9000b
   [junit4]   2> 988905 WARN  (jetty-launcher-1401-thread-1-SendThread(127.0.0.1:45293)) [n:127.0.0.1:45311_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 16760ms for sessionid 0x15e0e8e0bb90007
   [junit4]   2> 988905 WARN  (jetty-launcher-1401-thread-2-SendThread(127.0.0.1:45293)) [n:127.0.0.1:41587_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 16757ms for sessionid 0x15e0e8e0bb90008
   [junit4]   2> 988906 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e0e8e0bb90007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 988905 WARN  (jetty-launcher-1401-thread-2-SendThread(127.0.0.1:45293)) [n:127.0.0.1:41587_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13351ms for sessionid 0x15e0e8e0bb90006
   [junit4]   2> 988907 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e0e8e0bb90006, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 988907 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e0e8e0bb90008, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 988907 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1503518749431&s=irTZu7ItrBbq+Yk2TjZtVJu44gk="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:05:49 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:05:49 GMT
   [junit4]   2> 988907 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
   [junit4]   2> 988915 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
   [junit4]   2> 988916 INFO  (qtp204551648-10742) [n:127.0.0.1:45311_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 988916 INFO  (qtp204551648-10742) [n:127.0.0.1:45311_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 988917 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=test&e=1503518761781&s=biSJwHsP8ZY+hRjAq9a5eL8aH9g="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:06:01 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:06:01 GMT
   [junit4]   2> 988917 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
   [junit4]   2> 988924 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
   [junit4]   2> 988926 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[DDD9A826DE34A0B3]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=test&e=1503518761790&s=Zz7mKnlbxw5JT5O0/EL+IyI364c="; Path=/; Domain=127.0.0.1; Expires=mié, 23-ago-2017 20:06:01 GMT; Secure; HttpOnly". Invalid 'expires' attribute: mié, 23-ago-2017 20:06:01 GMT
   [junit4]   2> 988926 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[DDD9A826DE34A0B3]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
   [junit4]   2> 989007 INFO  (jetty-launcher-1401-thread-1-EventThread) [n:127.0.0.1:45311_solr    ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
   [junit4]   2> 989007 WARN  (zkCallback-1413-thread-1-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@35b042ae name: ZooKeeperConnection Watcher:127.0.0.1:45293/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 989007 WARN  (zkCallback-1413-thread-1-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 989009 INFO  (jetty-closer-1402-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@461e4cda{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 989010 INFO  (jetty-closer-1402-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1263960086
   [junit4]   2> 989010 INFO  (jetty-closer-1402-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@24cf6837{SSL,[ssl, http/1.1]}{127.0.0.1:0}
   [junit4]   2> 989010 INFO  (jetty-closer-1402-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 989010 INFO  (jetty-closer-1402-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=898707594
   [junit4]   2> 989010 INFO  (jetty-closer-1402-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4697018f: rootName = solr_45311, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@121aa09e
   [junit4]   2> 989010 INFO  (jetty-closer-1402-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 989010 INFO  (jetty-closer-1402-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@2468cff6: rootName = solr_41587, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@76051e39
   [junit4]   2> 989027 INFO  (jetty-closer-1402-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 989027 INFO  (jetty-closer-1402-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 989027 INFO  (jetty-closer-1402-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@4b384668: rootName = solr_41587, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3aa4869c
   [junit4]   2> 989027 INFO  (jetty-closer-1402-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@ba7ffde: rootName = solr_45311, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@3aa4869c
   [junit4]   2> 989033 INFO  (jetty-closer-1402-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 989033 INFO  (jetty-closer-1402-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@71d6a792: rootName = solr_45311, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5bde92c8
   [junit4]   2> 989033 INFO  (jetty-closer-1402-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 989033 INFO  (jetty-closer-1402-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@29afe21a: rootName = solr_41587, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@5bde92c8
   [junit4]   2> 989034 INFO  (jetty-closer-1402-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 989035 INFO  (jetty-closer-1402-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98532245093548037-127.0.0.1:45311_solr-n_0000000000) closing
   [junit4]   2> 989036 INFO  (OverseerStateUpdate-98532245093548037-127.0.0.1:45311_solr-n_0000000000) [n:127.0.0.1:45311_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45311_solr
   [junit4]   2> 989036 WARN  (zkCallback-1412-thread-2-processing-n:127.0.0.1:45311_solr) [n:127.0.0.1:45311_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 989037 ERROR (Thread[Thread-4484,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:45311_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 989241 INFO  (jetty-closer-1402-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@f121dc5{/solr,null,UNAVAILABLE}
   [junit4]   2> 990733 INFO  (jetty-launcher-1401-thread-2-EventThread) [n:127.0.0.1:41587_solr    ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
   [junit4]   2> 990828 INFO  (zkCallback-1413-thread-4-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41587_solr
   [junit4]   2> 990828 INFO  (zkCallback-1413-thread-6-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 990829 INFO  (jetty-closer-1402-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 990829 INFO  (coreCloseExecutor-3450-thread-1) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@620feb0d
   [junit4]   2> 990829 INFO  (coreCloseExecutor-3450-thread-1) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=1645210381
   [junit4]   2> 990829 INFO  (coreCloseExecutor-3450-thread-1) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@697250cc: rootName = solr_41587, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@797077f
   [junit4]   2> 990839 INFO  (coreCloseExecutor-3450-thread-1) [n:127.0.0.1:41587_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=1645210381
   [junit4]   2> 990841 WARN  (zkCallback-1413-thread-4-processing-n:127.0.0.1:41587_solr) [n:127.0.0.1:41587_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 990841 ERROR (Thread[Thread-4487,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:41587_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 990842 INFO  (jetty-closer-1402-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@b3880f6{/solr,null,UNAVAILABLE}
   [junit4]   2> 990842 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DDD9A826DE34A0B3]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 990842 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DDD9A826DE34A0B3]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45293 45293
   [junit4]   2> 997440 INFO  (Thread-4467) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:45293 45293
   [junit4]   2> 997441 WARN  (Thread-4467) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/collections/forwardingCollection/state.json
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 	3	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
   [junit4]   2> 
   [junit4]   2> 997460 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[DDD9A826DE34A0B3]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Aug 23, 2017 10:06:10 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> Aug 23, 2017 10:06:30 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   [junit4]   2>    1) Thread[id=10782, name=jetty-launcher-1401-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2>         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2>    2) Thread[id=10792, name=jetty-launcher-1401-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>         at sun.misc.Unsafe.park(Native Method)
   [junit4]   2>         at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
   [junit4]   2>         at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2>         at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2>         at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2>         at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2>         at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2>         at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2>         at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2> Aug 23, 2017 10:06:30 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: Starting to interrupt leaked threads:
   [junit4]   2>    1) Thread[id=10782, name=jetty-launcher-1401-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>    2) Thread[id=10792, name=jetty-launcher-1401-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2> 1017557 ERROR (jetty-launcher-1401-thread-2-EventThread) [n:127.0.0.1:41587_solr    ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2> 	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2> 	at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2> 	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2> 1017557 ERROR (jetty-launcher-1401-thread-1-EventThread) [n:127.0.0.1:45311_solr    ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
   [junit4]   2> java.lang.InterruptedException
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
   [junit4]   2> 	at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
   [junit4]   2> 	at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
   [junit4]   2> 	at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
   [junit4]   2> 	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
   [junit4]   2> Aug 23, 2017 10:06:30 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> INFO: All leaked threads terminated.
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1830, maxMBSortInHeap=7.907444902231738, sim=RandomSimilarity(queryNorm=false): {}, locale=es-PR, timezone=Etc/GMT+6
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=176700528,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [RulesTest, SegmentsInfoRequestHandlerTest, ChangedSchemaMergeTest, SolrIndexMetricsTest, PrimitiveFieldTypeTest, SpellCheckCollatorWithCollapseTest, CollectionReloadTest, HdfsRestartWhileUpdatingTest, TestSubQueryTransformerCrossCore, TestMultiWordSynonyms, SortByFunctionTest, DateFieldTest, TestJettySolrRunner, DistribJoinFromCollectionTest, TestSolrCoreProperties, CircularListTest, TestJmxIntegration, SparseHLLTest, AsyncCallRequestStatusResponseTest, CollectionsAPIAsyncDistributedZkTest, TestCollectionAPI, TestPseudoReturnFields, DistributedFacetPivotLargeTest, HardAutoCommitTest, TestSolrCloudSnapshots, TestLockTree, UnloadDistributedZkTest, TestCloudJSONFacetJoinDomain, TestLegacyFieldCache, RequiredFieldsTest, TestClassicSimilarityFactory, TestRTimerTree, TestQueryUtils, TestPrepRecovery, TestFileDictionaryLookup, NotRequiredUniqueKeyTest, CdcrReplicationDistributedZkTest, TestReversedWildcardFilterFactory, CoreAdminRequestStatusTest, TestAnalyzedSuggestions, TestFieldCollectionResource, TestPivotHelperCode, MetricsHandlerTest, TestSolrCoreParser, TestFieldTypeResource, TestSolrDeletionPolicy2, ZkStateWriterTest, TestUninvertingReader, MoveReplicaHDFSUlogDirTest, PreAnalyzedFieldTest, TestLFUCache, OverseerCollectionConfigSetProcessorTest, TestIntervalFaceting, ConfigSetsAPITest, TimeZoneUtilsTest, CursorMarkTest, Solr

[...truncated too long message...]

sed
 [ecj-lint] ----------
 [ecj-lint] 8. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/handler/component/DistributedDebugComponentTest.java (at line 221)
 [ecj-lint] 	throw new AssertionError(q.toString() + ": " + e.getMessage(), e);
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'client' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 9. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 204)
 [ecj-lint] 	Analyzer a1 = new WhitespaceAnalyzer();
 [ecj-lint] 	         ^^
 [ecj-lint] Resource leak: 'a1' is never closed
 [ecj-lint] ----------
 [ecj-lint] 10. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 207)
 [ecj-lint] 	OffsetWindowTokenFilter tots = new OffsetWindowTokenFilter(tokenStream);
 [ecj-lint] 	                        ^^^^
 [ecj-lint] Resource leak: 'tots' is never closed
 [ecj-lint] ----------
 [ecj-lint] 11. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 211)
 [ecj-lint] 	Analyzer a2 = new WhitespaceAnalyzer();
 [ecj-lint] 	         ^^
 [ecj-lint] Resource leak: 'a2' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 12. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/response/TestJavabinTupleStreamParser.java (at line 72)
 [ecj-lint] 	JavabinTupleStreamParser parser = new JavabinTupleStreamParser(new ByteArrayInputStream(bytes), true);
 [ecj-lint] 	                         ^^^^^^
 [ecj-lint] Resource leak: 'parser' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 13. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 243)
 [ecj-lint] 	return loadfactor!=0 ? new HashDocSet(a,0,n,1/loadfactor) : new HashDocSet(a,0,n);
 [ecj-lint] 	                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] 14. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 528)
 [ecj-lint] 	DocSet a = new BitDocSet(bs);
 [ecj-lint] 	       ^
 [ecj-lint] Resource leak: 'a' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 15. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 76)
 [ecj-lint] 	final MockPKIAuthenticationPlugin mock = new MockPKIAuthenticationPlugin(null, nodeName);
 [ecj-lint] 	                                  ^^^^
 [ecj-lint] Resource leak: 'mock' is never closed
 [ecj-lint] ----------
 [ecj-lint] 16. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 131)
 [ecj-lint] 	MockPKIAuthenticationPlugin mock1 = new MockPKIAuthenticationPlugin(null, nodeName) {
 [ecj-lint] 	                            ^^^^^
 [ecj-lint] Resource leak: 'mock1' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 17. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestRuleBasedAuthorizationPlugin.java (at line 380)
 [ecj-lint] 	RuleBasedAuthorizationPlugin plugin = new RuleBasedAuthorizationPlugin();
 [ecj-lint] 	                             ^^^^^^
 [ecj-lint] Resource leak: 'plugin' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 18. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestSha256AuthenticationProvider.java (at line 49)
 [ecj-lint] 	BasicAuthPlugin basicAuthPlugin = new BasicAuthPlugin();
 [ecj-lint] 	                ^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'basicAuthPlugin' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 19. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/spelling/SimpleQueryConverter.java (at line 42)
 [ecj-lint] 	WhitespaceAnalyzer analyzer = new WhitespaceAnalyzer();
 [ecj-lint] 	                   ^^^^^^^^
 [ecj-lint] Resource leak: 'analyzer' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 20. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 139)
 [ecj-lint] 	IndexWriter w = new IndexWriter(d, newIndexWriterConfig(analyzer));
 [ecj-lint] 	            ^
 [ecj-lint] Resource leak: 'w' is never closed
 [ecj-lint] ----------
 [ecj-lint] 21. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 172)
 [ecj-lint] 	throw iae;
 [ecj-lint] 	^^^^^^^^^^
 [ecj-lint] Resource leak: 'w' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] 22. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 178)
 [ecj-lint] 	return;
 [ecj-lint] 	^^^^^^^
 [ecj-lint] Resource leak: 'w' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 23. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 134)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 24. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 333)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 25. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 367)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 26. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 413)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 27. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 458)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 28. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 516)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 29. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 181)
 [ecj-lint] 	EmbeddedSolrServer server1 = new EmbeddedSolrServer(h.getCoreContainer(), "split1");
 [ecj-lint] 	                   ^^^^^^^
 [ecj-lint] Resource leak: 'server1' is never closed
 [ecj-lint] ----------
 [ecj-lint] 30. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 182)
 [ecj-lint] 	EmbeddedSolrServer server2 = new EmbeddedSolrServer(h.getCoreContainer(), "split2");
 [ecj-lint] 	                   ^^^^^^^
 [ecj-lint] Resource leak: 'server2' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 31. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/processor/RecordingUpdateProcessorFactory.java (at line 67)
 [ecj-lint] 	return recording ? new RecordingUpdateRequestProcessor(commandQueue, next) : next;
 [ecj-lint] 	                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] 31 problems (1 error, 30 warnings)

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:810: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:101: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build.xml:689: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:2013: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:2046: Compile failed; see the compiler error output for details.

Total time: 75 minutes 40 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20361 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20361/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseSerialGC

3 tests failed.
FAILED:  org.apache.solr.cloud.CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster

Error Message:
Document mismatch on target after sync expected:<2000> but was:<1901>

Stack Trace:
java.lang.AssertionError: Document mismatch on target after sync expected:<2000> but was:<1901>
	at __randomizedtesting.SeedInfo.seed([9DE1083ACC66B61E:49A443632B3005E5]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.failNotEquals(Assert.java:647)
	at org.junit.Assert.assertEquals(Assert.java:128)
	at org.junit.Assert.assertEquals(Assert.java:472)
	at org.apache.solr.cloud.CdcrBootstrapTest.testBootstrapWithContinousIndexingOnSourceCluster(CdcrBootstrapTest.java:309)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader

Error Message:
Doc with id=1 not found in http://127.0.0.1:40059/_e/j/forceleader_test_collection due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:40059/_e/j/forceleader_test_collection due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([9DE1083ACC66B61E:7B763CFAF5E44F7F]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:556)
	at org.apache.solr.cloud.ForceLeaderTest.testReplicasInLIRNoLeader(ForceLeaderTest.java:142)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([9DE1083ACC66B61E:C205250DA76A255B]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:84)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11740 lines...]
   [junit4] Suite: org.apache.solr.cloud.CdcrBootstrapTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_9DE1083ACC66B61E-001/init-core-data-001
   [junit4]   2> 956981 INFO  (SUITE-CdcrBootstrapTest-seed#[9DE1083ACC66B61E]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 956981 INFO  (SUITE-CdcrBootstrapTest-seed#[9DE1083ACC66B61E]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 956981 INFO  (SUITE-CdcrBootstrapTest-seed#[9DE1083ACC66B61E]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 956982 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[9DE1083ACC66B61E]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testBootstrapWithSourceCluster
   [junit4]   2> 956982 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[9DE1083ACC66B61E]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_9DE1083ACC66B61E-001/cdcr-target-001
   [junit4]   2> 956982 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[9DE1083ACC66B61E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 956983 INFO  (Thread-3344) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 956983 INFO  (Thread-3344) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 956984 ERROR (Thread-3344) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 957083 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[9DE1083ACC66B61E]) [    ] o.a.s.c.ZkTestServer start zk server on port:34993
   [junit4]   2> 957087 INFO  (jetty-launcher-1202-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 957087 INFO  (jetty-launcher-1202-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@35c64dc9{/solr,null,AVAILABLE}
   [junit4]   2> 957088 INFO  (jetty-launcher-1202-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6cfd1afd{HTTP/1.1,[http/1.1]}{127.0.0.1:39471}
   [junit4]   2> 957088 INFO  (jetty-launcher-1202-thread-1) [    ] o.e.j.s.Server Started @958441ms
   [junit4]   2> 957088 INFO  (jetty-launcher-1202-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=39471}
   [junit4]   2> 957088 ERROR (jetty-launcher-1202-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 957088 INFO  (jetty-launcher-1202-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 957089 INFO  (jetty-launcher-1202-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 957089 INFO  (jetty-launcher-1202-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 957089 INFO  (jetty-launcher-1202-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-23T05:06:53.625Z
   [junit4]   2> 957090 INFO  (jetty-launcher-1202-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 957094 INFO  (jetty-launcher-1202-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:34993/solr
   [junit4]   2> 957114 INFO  (jetty-launcher-1202-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 957115 INFO  (jetty-launcher-1202-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:39471_solr
   [junit4]   2> 957115 INFO  (jetty-launcher-1202-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.c.Overseer Overseer (id=98531070018781187-127.0.0.1:39471_solr-n_0000000000) starting
   [junit4]   2> 957116 INFO  (jetty-launcher-1202-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:39471_solr
   [junit4]   2> 957117 INFO  (zkCallback-1209-thread-1-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 957169 INFO  (jetty-launcher-1202-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39471.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3bfcc018
   [junit4]   2> 957173 INFO  (jetty-launcher-1202-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39471.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3bfcc018
   [junit4]   2> 957174 INFO  (jetty-launcher-1202-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39471.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3bfcc018
   [junit4]   2> 957174 INFO  (jetty-launcher-1202-thread-1) [n:127.0.0.1:39471_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_9DE1083ACC66B61E-001/cdcr-target-001/node1/.
   [junit4]   2> 957186 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e0d7c73cf0005, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   1> Target zkHost = 127.0.0.1:34993/solr
   [junit4]   2> 957186 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[9DE1083ACC66B61E]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 1 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_9DE1083ACC66B61E-001/cdcr-source-001
   [junit4]   2> 957187 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[9DE1083ACC66B61E]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 957187 INFO  (Thread-3354) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 957187 INFO  (Thread-3354) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 957188 ERROR (Thread-3354) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 957287 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[9DE1083ACC66B61E]) [    ] o.a.s.c.ZkTestServer start zk server on port:36319
   [junit4]   2> 957295 INFO  (jetty-launcher-1214-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 957296 INFO  (jetty-launcher-1214-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@47bd8dd7{/solr,null,AVAILABLE}
   [junit4]   2> 957296 INFO  (jetty-launcher-1214-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6fe6da3e{HTTP/1.1,[http/1.1]}{127.0.0.1:38163}
   [junit4]   2> 957297 INFO  (jetty-launcher-1214-thread-1) [    ] o.e.j.s.Server Started @958649ms
   [junit4]   2> 957297 INFO  (jetty-launcher-1214-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38163}
   [junit4]   2> 957297 ERROR (jetty-launcher-1214-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 957297 INFO  (jetty-launcher-1214-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 957297 INFO  (jetty-launcher-1214-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 957297 INFO  (jetty-launcher-1214-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 957297 INFO  (jetty-launcher-1214-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-23T05:06:53.833Z
   [junit4]   2> 957299 INFO  (jetty-launcher-1214-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 957306 INFO  (jetty-launcher-1214-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:36319/solr
   [junit4]   2> 957355 INFO  (jetty-launcher-1214-thread-1) [n:127.0.0.1:38163_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 957356 INFO  (jetty-launcher-1214-thread-1) [n:127.0.0.1:38163_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38163_solr
   [junit4]   2> 957356 INFO  (jetty-launcher-1214-thread-1) [n:127.0.0.1:38163_solr    ] o.a.s.c.Overseer Overseer (id=98531070032150531-127.0.0.1:38163_solr-n_0000000000) starting
   [junit4]   2> 957360 INFO  (jetty-launcher-1214-thread-1) [n:127.0.0.1:38163_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38163_solr
   [junit4]   2> 957361 INFO  (zkCallback-1221-thread-1-processing-n:127.0.0.1:38163_solr) [n:127.0.0.1:38163_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 957419 INFO  (jetty-launcher-1214-thread-1) [n:127.0.0.1:38163_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38163.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3bfcc018
   [junit4]   2> 957423 INFO  (jetty-launcher-1214-thread-1) [n:127.0.0.1:38163_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38163.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3bfcc018
   [junit4]   2> 957423 INFO  (jetty-launcher-1214-thread-1) [n:127.0.0.1:38163_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38163.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3bfcc018
   [junit4]   2> 957424 INFO  (jetty-launcher-1214-thread-1) [n:127.0.0.1:38163_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_9DE1083ACC66B61E-001/cdcr-source-001/node1/.
   [junit4]   2> 957441 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[9DE1083ACC66B61E]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 957441 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[9DE1083ACC66B61E]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:36319/solr ready
   [junit4]   2> 957442 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=cdcr-source&name=cdcr-source&nrtReplicas=1&action=CREATE&numShards=1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 957443 INFO  (OverseerThreadFactory-3544-thread-1-processing-n:127.0.0.1:38163_solr) [n:127.0.0.1:38163_solr    ] o.a.s.c.CreateCollectionCmd Create collection cdcr-source
   [junit4]   2> 957545 INFO  (OverseerStateUpdate-98531070032150531-127.0.0.1:38163_solr-n_0000000000) [n:127.0.0.1:38163_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"cdcr-source",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"cdcr-source_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:38163/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 957747 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=cdcr-source&newCollection=true&collection=cdcr-source&version=2&replicaType=NRT&coreNodeName=core_node2&name=cdcr-source_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 957747 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 957851 INFO  (zkCallback-1221-thread-1-processing-n:127.0.0.1:38163_solr) [n:127.0.0.1:38163_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-source/state.json] for collection [cdcr-source] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 957851 INFO  (zkCallback-1221-thread-2-processing-n:127.0.0.1:38163_solr) [n:127.0.0.1:38163_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-source/state.json] for collection [cdcr-source] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 958753 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 958756 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 958757 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.IndexSchema [cdcr-source_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 958758 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 958759 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/cdcr-source/managed-schema
   [junit4]   2> 958759 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/cdcr-source/schema.xml to /configs/cdcr-source/schema.xml.bak
   [junit4]   2> 958759 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-source_shard1_replica_n1' using configuration from collection cdcr-source, trusted=true
   [junit4]   2> 958760 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38163.solr.core.cdcr-source.shard1.replica_n1' (registry 'solr.core.cdcr-source.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3bfcc018
   [junit4]   2> 958760 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 958760 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [[cdcr-source_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_9DE1083ACC66B61E-001/cdcr-source-001/node1/cdcr-source_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_9DE1083ACC66B61E-001/cdcr-source-001/node1/./cdcr-source_shard1_replica_n1/data/]
   [junit4]   2> 958820 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 958820 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 958820 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 958820 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 958822 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@64c70b64[cdcr-source_shard1_replica_n1] main]
   [junit4]   2> 958822 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-source
   [junit4]   2> 958823 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-source
   [junit4]   2> 958823 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-source/managed-schema
   [junit4]   2> 958823 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 958823 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 958837 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrBufferStateManager Created znode /collections/cdcr-source/cdcr/state/buffer
   [junit4]   2> 958840 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrProcessStateManager Created znode /collections/cdcr-source/cdcr/state/process
   [junit4]   2> 958854 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576497122262384640
   [junit4]   2> 958855 INFO  (searcherExecutor-3547-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] Registered new searcher Searcher@64c70b64[cdcr-source_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 958857 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 958857 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 958857 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38163/solr/cdcr-source_shard1_replica_n1/
   [junit4]   2> 958857 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 958857 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:38163/solr/cdcr-source_shard1_replica_n1/ has no replicas
   [junit4]   2> 958857 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 958858 INFO  (zkCallback-1221-thread-2-processing-n:127.0.0.1:38163_solr) [n:127.0.0.1:38163_solr    ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-source:shard1
   [junit4]   2> 958860 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38163/solr/cdcr-source_shard1_replica_n1/ shard1
   [junit4]   2> 958961 INFO  (zkCallback-1221-thread-1-processing-n:127.0.0.1:38163_solr) [n:127.0.0.1:38163_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-source/state.json] for collection [cdcr-source] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 958961 INFO  (zkCallback-1221-thread-2-processing-n:127.0.0.1:38163_solr) [n:127.0.0.1:38163_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-source/state.json] for collection [cdcr-source] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 959010 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 959011 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=cdcr-source&newCollection=true&collection=cdcr-source&version=2&replicaType=NRT&coreNodeName=core_node2&name=cdcr-source_shard1_replica_n1&action=CREATE&numShards=1&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=1264
   [junit4]   2> 959013 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 959113 INFO  (zkCallback-1221-thread-1-processing-n:127.0.0.1:38163_solr) [n:127.0.0.1:38163_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-source/state.json] for collection [cdcr-source] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 959113 INFO  (zkCallback-1221-thread-3-processing-n:127.0.0.1:38163_solr) [n:127.0.0.1:38163_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-source/state.json] for collection [cdcr-source] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 959444 INFO  (OverseerCollectionConfigSetProcessor-98531070032150531-127.0.0.1:38163_solr-n_0000000000) [n:127.0.0.1:38163_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 960013 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=cdcr-source&name=cdcr-source&nrtReplicas=1&action=CREATE&numShards=1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2} status=0 QTime=2570
   [junit4]   1> Adding 10 docs with commit=true, numDocs=100
   [junit4]   2> 960042 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&wt=javabin&version=2} status=0 QTime=26
   [junit4]   2> 960043 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497123509141504,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 960043 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1adffe95 commitCommandVersion:1576497123509141504
   [junit4]   2> 960136 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4ab80b1d[cdcr-source_shard1_replica_n1] main]
   [junit4]   2> 960137 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 960137 INFO  (searcherExecutor-3547-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] Registered new searcher Searcher@4ab80b1d[cdcr-source_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C100)))}
   [junit4]   2> 960137 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=94
   [junit4]   1> Adding 10 docs with commit=true, numDocs=200
   [junit4]   2> 960141 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 960142 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497123612950528,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 960143 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1adffe95 commitCommandVersion:1576497123612950528
   [junit4]   2> 960253 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2a080022[cdcr-source_shard1_replica_n1] main]
   [junit4]   2> 960253 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 960254 INFO  (searcherExecutor-3547-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] Registered new searcher Searcher@2a080022[cdcr-source_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C100) Uninverting(_1(8.0.0):C100)))}
   [junit4]   2> 960254 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=112
   [junit4]   1> Adding 10 docs with commit=true, numDocs=300
   [junit4]   2> 960258 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 960258 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497123734585346,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 960258 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1adffe95 commitCommandVersion:1576497123734585346
   [junit4]   2> 960381 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@31db4941[cdcr-source_shard1_replica_n1] main]
   [junit4]   2> 960381 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 960382 INFO  (searcherExecutor-3547-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] Registered new searcher Searcher@31db4941[cdcr-source_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C100) Uninverting(_1(8.0.0):C100) Uninverting(_2(8.0.0):C100)))}
   [junit4]   2> 960383 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=124
   [junit4]   1> Adding 10 docs with commit=true, numDocs=400
   [junit4]   2> 960386 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 960386 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497123868803076,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 960386 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1adffe95 commitCommandVersion:1576497123868803076
   [junit4]   2> 960517 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4f7661f1[cdcr-source_shard1_replica_n1] main]
   [junit4]   2> 960517 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 960518 INFO  (searcherExecutor-3547-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] Registered new searcher Searcher@4f7661f1[cdcr-source_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C100) Uninverting(_1(8.0.0):C100) Uninverting(_2(8.0.0):C100) Uninverting(_3(8.0.0):C100)))}
   [junit4]   2> 960518 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=132
   [junit4]   1> Adding 10 docs with commit=true, numDocs=500
   [junit4]   2> 960522 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 960522 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497124011409427,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 960522 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1adffe95 commitCommandVersion:1576497124011409427
   [junit4]   2> 960677 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4d096c8f[cdcr-source_shard1_replica_n1] main]
   [junit4]   2> 960678 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 960678 INFO  (searcherExecutor-3547-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] Registered new searcher Searcher@4d096c8f[cdcr-source_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C100) Uninverting(_1(8.0.0):C100) Uninverting(_2(8.0.0):C100) Uninverting(_3(8.0.0):C100) Uninverting(_4(8.0.0):C100)))}
   [junit4]   2> 960678 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=156
   [junit4]   1> Adding 10 docs with commit=true, numDocs=600
   [junit4]   2> 960681 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 960681 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497124178133023,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 960681 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1adffe95 commitCommandVersion:1576497124178133023
   [junit4]   2> 960856 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@56e10540[cdcr-source_shard1_replica_n1] main]
   [junit4]   2> 960857 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 960858 INFO  (searcherExecutor-3547-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] Registered new searcher Searcher@56e10540[cdcr-source_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C100) Uninverting(_1(8.0.0):C100) Uninverting(_2(8.0.0):C100) Uninverting(_3(8.0.0):C100) Uninverting(_4(8.0.0):C100) Uninverting(_5(8.0.0):C100)))}
   [junit4]   2> 960858 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=177
   [junit4]   1> Adding 10 docs with commit=true, numDocs=700
   [junit4]   2> 960863 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 960864 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497124370022400,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 960864 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1adffe95 commitCommandVersion:1576497124370022400
   [junit4]   2> 961067 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@6c4407cc[cdcr-source_shard1_replica_n1] main]
   [junit4]   2> 961068 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 961069 INFO  (searcherExecutor-3547-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] Registered new searcher Searcher@6c4407cc[cdcr-source_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C100) Uninverting(_1(8.0.0):C100) Uninverting(_2(8.0.0):C100) Uninverting(_3(8.0.0):C100) Uninverting(_4(8.0.0):C100) Uninverting(_5(8.0.0):C100) Uninverting(_6(8.0.0):C100)))}
   [junit4]   2> 961069 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=205
   [junit4]   1> Adding 10 docs with commit=true, numDocs=800
   [junit4]   2> 961071 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 961072 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497124588126208,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 961072 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1adffe95 commitCommandVersion:1576497124588126208
   [junit4]   2> 961345 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@df7e950[cdcr-source_shard1_replica_n1] main]
   [junit4]   2> 961345 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 961346 INFO  (searcherExecutor-3547-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] Registered new searcher Searcher@df7e950[cdcr-source_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C100) Uninverting(_1(8.0.0):C100) Uninverting(_2(8.0.0):C100) Uninverting(_3(8.0.0):C100) Uninverting(_4(8.0.0):C100) Uninverting(_5(8.0.0):C100) Uninverting(_6(8.0.0):C100) Uninverting(_7(8.0.0):C100)))}
   [junit4]   2> 961346 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=274
   [junit4]   1> Adding 10 docs with commit=true, numDocs=900
   [junit4]   2> 961349 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 961350 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497124879630336,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 961350 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1adffe95 commitCommandVersion:1576497124879630336
   [junit4]   2> 961692 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1babf19e[cdcr-source_shard1_replica_n1] main]
   [junit4]   2> 961692 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 961693 INFO  (searcherExecutor-3547-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] Registered new searcher Searcher@1babf19e[cdcr-source_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C100) Uninverting(_1(8.0.0):C100) Uninverting(_2(8.0.0):C100) Uninverting(_3(8.0.0):C100) Uninverting(_4(8.0.0):C100) Uninverting(_5(8.0.0):C100) Uninverting(_6(8.0.0):C100) Uninverting(_7(8.0.0):C100) Uninverting(_8(8.0.0):C100)))}
   [junit4]   2> 961693 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=343
   [junit4]   1> Adding 10 docs with commit=true, numDocs=1000
   [junit4]   2> 961696 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 961696 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497125242437636,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 961696 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1adffe95 commitCommandVersion:1576497125242437636
   [junit4]   2> 962046 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1971a14[cdcr-source_shard1_replica_n1] main]
   [junit4]   2> 962046 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 962047 INFO  (searcherExecutor-3547-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-source_shard1_replica_n1] Registered new searcher Searcher@1971a14[cdcr-source_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C100) Uninverting(_1(8.0.0):C100) Uninverting(_2(8.0.0):C100) Uninverting(_3(8.0.0):C100) Uninverting(_4(8.0.0):C100) Uninverting(_5(8.0.0):C100) Uninverting(_6(8.0.0):C100) Uninverting(_7(8.0.0):C100) Uninverting(_8(8.0.0):C100) Uninverting(_9(8.0.0):C100)))}
   [junit4]   2> 962047 INFO  (qtp119908800-9088) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-source:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=350
   [junit4]   2> 962048 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=cdcr-source:4&wt=javabin&version=2} hits=1000 status=0 QTime=0
   [junit4]   2> 962054 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[9DE1083ACC66B61E]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 962055 INFO  (TEST-CdcrBootstrapTest.testBootstrapWithSourceCluster-seed#[9DE1083ACC66B61E]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34993/solr ready
   [junit4]   2> 962055 INFO  (qtp943963957-9045) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=cdcr-target&name=cdcr-target&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 962057 INFO  (OverseerThreadFactory-3536-thread-1-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.CreateCollectionCmd Create collection cdcr-target
   [junit4]   2> 962167 INFO  (OverseerStateUpdate-98531070018781187-127.0.0.1:39471_solr-n_0000000000) [n:127.0.0.1:39471_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"cdcr-target",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"cdcr-target_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:39471/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 962370 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=cdcr-target&newCollection=true&name=cdcr-target_shard1_replica_n1&action=CREATE&numShards=1&collection=cdcr-target&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 962371 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 962480 INFO  (zkCallback-1209-thread-1-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-target/state.json] for collection [cdcr-target] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 962480 INFO  (zkCallback-1209-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-target/state.json] for collection [cdcr-target] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 963385 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 963388 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory The schema is configured as managed, but managed schema resource managed-schema not found - loading non-managed schema schema.xml instead
   [junit4]   2> 963389 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.s.IndexSchema [cdcr-target_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 963391 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 963391 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.s.ManagedIndexSchema Created and persisted managed schema znode at /configs/cdcr-target/managed-schema
   [junit4]   2> 963392 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.s.ManagedIndexSchemaFactory After upgrading to managed schema in ZooKeeper, renamed the non-managed schema /configs/cdcr-target/schema.xml to /configs/cdcr-target/schema.xml.bak
   [junit4]   2> 963392 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'cdcr-target_shard1_replica_n1' using configuration from collection cdcr-target, trusted=true
   [junit4]   2> 963392 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_39471.solr.core.cdcr-target.shard1.replica_n1' (registry 'solr.core.cdcr-target.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@3bfcc018
   [junit4]   2> 963392 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 963393 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.SolrCore [[cdcr-target_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_9DE1083ACC66B61E-001/cdcr-target-001/node1/cdcr-target_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.CdcrBootstrapTest_9DE1083ACC66B61E-001/cdcr-target-001/node1/./cdcr-target_shard1_replica_n1/data/]
   [junit4]   2> 963436 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.CdcrUpdateLog
   [junit4]   2> 963436 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 963437 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 963437 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 963438 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@48ae3efb[cdcr-target_shard1_replica_n1] main]
   [junit4]   2> 963439 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/cdcr-target
   [junit4]   2> 963439 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/cdcr-target
   [junit4]   2> 963439 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Creating ZooKeeper watch for the managed schema at /configs/cdcr-target/managed-schema
   [junit4]   2> 963439 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.s.ZkIndexSchemaReader Current schema version 0 is already the latest
   [junit4]   2> 963440 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 963441 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrBufferStateManager Created znode /collections/cdcr-target/cdcr/state/buffer
   [junit4]   2> 963441 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrProcessStateManager Created znode /collections/cdcr-target/cdcr/state/process
   [junit4]   2> 963442 INFO  (searcherExecutor-3553-thread-1-processing-n:127.0.0.1:39471_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.SolrCore [cdcr-target_shard1_replica_n1] Registered new searcher Searcher@48ae3efb[cdcr-target_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 963442 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576497127073251328
   [junit4]   2> 963445 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 963445 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 963445 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:39471/solr/cdcr-target_shard1_replica_n1/
   [junit4]   2> 963445 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 963445 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:39471/solr/cdcr-target_shard1_replica_n1/ has no replicas
   [junit4]   2> 963445 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 963449 INFO  (zkCallback-1209-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.h.CdcrLeaderStateManager Received new leader state @ cdcr-target:shard1
   [junit4]   2> 963450 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:39471/solr/cdcr-target_shard1_replica_n1/ shard1
   [junit4]   2> 963551 INFO  (zkCallback-1209-thread-1-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-target/state.json] for collection [cdcr-target] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 963551 INFO  (zkCallback-1209-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-target/state.json] for collection [cdcr-target] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 963600 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 963601 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=cdcr-target&newCollection=true&name=cdcr-target_shard1_replica_n1&action=CREATE&numShards=1&collection=cdcr-target&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1231
   [junit4]   2> 963603 INFO  (qtp943963957-9045) [n:127.0.0.1:39471_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 963703 INFO  (zkCallback-1209-thread-1-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-target/state.json] for collection [cdcr-target] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 963703 INFO  (zkCallback-1209-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-target/state.json] for collection [cdcr-target] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 964058 INFO  (OverseerCollectionConfigSetProcessor-98531070018781187-127.0.0.1:39471_solr-n_0000000000) [n:127.0.0.1:39471_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 964603 INFO  (qtp943963957-9045) [n:127.0.0.1:39471_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=cdcr-target&name=cdcr-target&nrtReplicas=1&action=CREATE&numShards=1&wt=javabin&version=2} status=0 QTime=2547
   [junit4]   2> 964606 INFO  (zkCallback-1209-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.h.CdcrProcessStateManager The CDCR process state has changed: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-target/cdcr/state/process @ cdcr-target:shard1
   [junit4]   2> 964606 INFO  (qtp943963957-9046) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&_stateVer_=cdcr-target:4&action=start&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 964606 INFO  (zkCallback-1209-thread-2-processing-n:127.0.0.1:39471_solr) [n:127.0.0.1:39471_solr    ] o.a.s.h.CdcrProcessStateManager Received new CDCR process state from watcher: STARTED @ cdcr-target:shard1
   [junit4]   2> 964608 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 964608 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:34993/solr ready
   [junit4]   2> 964612 INFO  (qtp943963957-9046) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.CdcrRequestHandler Found maxVersionFromRecent 0 maxVersionFromIndex 0
   [junit4]   2> 964612 INFO  (qtp943963957-9046) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/cdcr params={action=SHARDCHECKPOINT&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 964612 INFO  (qtp943963957-9047) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/cdcr params={_stateVer_=cdcr-target:4&action=COLLECTIONCHECKPOINT&wt=javabin&version=2} status=0 QTime=3
   [junit4]   2> 964612 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Create new update log reader for target cdcr-target with checkpoint -1 @ cdcr-source:shard1
   [junit4]   2> 964612 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Attempting to bootstrap target collection: cdcr-target, shard: shard1
   [junit4]   2> 964615 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Submitting bootstrap task to executor
   [junit4]   2> 964616 INFO  (zkCallback-1221-thread-1-processing-n:127.0.0.1:38163_solr) [n:127.0.0.1:38163_solr    ] o.a.s.h.CdcrProcessStateManager The CDCR process state has changed: WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/cdcr-source/cdcr/state/process @ cdcr-source:shard1
   [junit4]   2> 964616 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&_stateVer_=cdcr-source:4&action=start&wt=javabin&version=2} status=0 QTime=9
   [junit4]   2> 964616 INFO  (zkCallback-1221-thread-1-processing-n:127.0.0.1:38163_solr) [n:127.0.0.1:38163_solr    ] o.a.s.h.CdcrProcessStateManager Received new CDCR process state from watcher: STARTED @ cdcr-source:shard1
   [junit4]   2> 964617 INFO  (qtp119908800-9086) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&_stateVer_=cdcr-source:4&action=queues&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 964617 INFO  (cdcr-bootstrap-status-1233-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager Attempting to bootstrap target collection: cdcr-target shard: shard1 leader: http://127.0.0.1:39471/solr/cdcr-target_shard1_replica_n1/
   [junit4]   1> Cdcr queue response: {responseHeader={status=0,QTime=0},queues={127.0.0.1:34993/solr={cdcr-target={queueSize=1010,lastTimestamp=}}},tlogTotalSize=47659,tlogTotalCount=10,updateLogSynchronizer=stopped}
   [junit4]   2> 964618 INFO  (qtp943963957-9041) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497128306376704,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 964619 INFO  (qtp943963957-9041) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 964619 INFO  (qtp943963957-9041) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 964619 INFO  (qtp943963957-9041) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/update params={_stateVer_=cdcr-target:4&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2} status=0 QTime=1
   [junit4]   2> 964620 INFO  (qtp943963957-9043) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=cdcr-target:4&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 964620 INFO  (qtp943963957-9045) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&masterUrl=http://127.0.0.1:38163/solr/cdcr-source_shard1_replica_n1/&action=BOOTSTRAP&wt=javabin&version=2} status=0 QTime=2
   [junit4]   2> 964621 INFO  (recoveryExecutor-1207-thread-1-processing-n:127.0.0.1:39471_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 964622 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576497128310571008,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 964622 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@1adffe95 commitCommandVersion:1576497128310571008
   [junit4]   2> 964628 INFO  (qtp943963957-9046) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.c.S.Request [cdcr-target_shard1_replica_n1]  webapp=/solr path=/cdcr params={qt=/cdcr&action=BOOTSTRAP_STATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 964628 INFO  (cdcr-bootstrap-status-1233-thread-1-processing-n:127.0.0.1:38163_solr x:cdcr-source_shard1_replica_n1 s:shard1 c:cdcr-source r:core_node2) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.CdcrReplicatorManager CDCR bootstrap running for 1 seconds, sleeping for 2000 ms
   [junit4]   2> 964726 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@363e0a9a[cdcr-source_shard1_replica_n1] realtime]
   [junit4]   2> 964726 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 964726 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2} status=0 QTime=103
   [junit4]   2> 964727 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 964727 INFO  (recoveryExecutor-1207-thread-1-processing-n:127.0.0.1:39471_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Master's generation: 12
   [junit4]   2> 964727 INFO  (recoveryExecutor-1207-thread-1-processing-n:127.0.0.1:39471_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Master's version: 1503464821158
   [junit4]   2> 964727 INFO  (recoveryExecutor-1207-thread-1-processing-n:127.0.0.1:39471_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 964727 INFO  (recoveryExecutor-1207-thread-1-processing-n:127.0.0.1:39471_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 964727 INFO  (recoveryExecutor-1207-thread-1-processing-n:127.0.0.1:39471_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Starting replication process
   [junit4]   2> 964730 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.h.ReplicationHandler Adding tlog files to list: [{size=4657, name=tlog.0000000000000000000.1576497123480829952}, {size=4778, name=tlog.0000000000000000001.1576497123608756224}, {size=4778, name=tlog.0000000000000000002.1576497123731439616}, {size=4778, name=tlog.0000000000000000003.1576497123865657344}, {size=4778, name=tlog.0000000000000000004.1576497124008263680}, {size=4778, name=tlog.0000000000000000005.1576497124176035840}, {size=4778, name=tlog.0000000000000000006.1576497124365828096}, {size=4778, name=tlog.0000000000000000007.1576497124586029056}, {size=4778, name=tlog.0000000000000000008.1576497124876484608}, {size=4778, name=tlog.0000000000000000009.1576497125240340480}]
   [junit4]   2> 964730 INFO  (qtp119908800-9082) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/replication params={generation=12&qt=/replication&wt=javabin&version=2&command=filelist} status=0 QTime=2
   [junit4]   2> 964730 INFO  (recoveryExecutor-1207-thread-1-processing-n:127.0.0.1:39471_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Number of files in latest index in master: 21
   [junit4]   2> 964730 INFO  (recoveryExecutor-1207-thread-1-processing-n:127.0.0.1:39471_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Number of tlog files in master: 10
   [junit4]   2> 964732 INFO  (recoveryExecutor-1207-thread-1-processing-n:127.0.0.1:39471_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.u.DefaultSolrCoreState New IndexWriter is ready to be used.
   [junit4]   2> 964732 INFO  (recoveryExecutor-1207-thread-1-processing-n:127.0.0.1:39471_solr x:cdcr-target_shard1_replica_n1 s:shard1 c:cdcr-target r:core_node2) [n:127.0.0.1:39471_solr c:cdcr-target s:shard1 r:core_node2 x:cdcr-target_shard1_replica_n1] o.a.s.h.IndexFetcher Starting download (fullCopy=false) to MockDirectoryWrapper(RAMDirectory@4b00c1f4 lockFactory=org.apache.lucene.store.SingleInstanceLockFactory@3da8cb72)
   [junit4]   2> 964733 INFO  (qtp119908800-9083) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/replication params={generation=12&qt=/replication&file=_a_Memory_0.ram&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 964734 INFO  (qtp119908800-9084) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/replication params={generation=12&qt=/replication&file=_a_Asserting_0.dvd&checksum=true&wt=filestream&command=filecontent} status=0 QTime=0
   [junit4]   2> 964735 INFO  (qtp119908800-9087) [n:127.0.0.1:38163_solr c:cdcr-source s:shard1 r:core_node2 x:cdcr-source_shard1_replica_n1] o.a.s.c.S.Request [cdcr-source_shard1_replica_n1]  webapp=/solr path=/replication params={generation=12&qt=/replication&f

[...truncated too long message...]

osed
 [ecj-lint] ----------
 [ecj-lint] 8. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/handler/component/DistributedDebugComponentTest.java (at line 221)
 [ecj-lint] 	throw new AssertionError(q.toString() + ": " + e.getMessage(), e);
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'client' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 9. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 204)
 [ecj-lint] 	Analyzer a1 = new WhitespaceAnalyzer();
 [ecj-lint] 	         ^^
 [ecj-lint] Resource leak: 'a1' is never closed
 [ecj-lint] ----------
 [ecj-lint] 10. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 207)
 [ecj-lint] 	OffsetWindowTokenFilter tots = new OffsetWindowTokenFilter(tokenStream);
 [ecj-lint] 	                        ^^^^
 [ecj-lint] Resource leak: 'tots' is never closed
 [ecj-lint] ----------
 [ecj-lint] 11. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 211)
 [ecj-lint] 	Analyzer a2 = new WhitespaceAnalyzer();
 [ecj-lint] 	         ^^
 [ecj-lint] Resource leak: 'a2' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 12. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/response/TestJavabinTupleStreamParser.java (at line 72)
 [ecj-lint] 	JavabinTupleStreamParser parser = new JavabinTupleStreamParser(new ByteArrayInputStream(bytes), true);
 [ecj-lint] 	                         ^^^^^^
 [ecj-lint] Resource leak: 'parser' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 13. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 243)
 [ecj-lint] 	return loadfactor!=0 ? new HashDocSet(a,0,n,1/loadfactor) : new HashDocSet(a,0,n);
 [ecj-lint] 	                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] 14. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 528)
 [ecj-lint] 	DocSet a = new BitDocSet(bs);
 [ecj-lint] 	       ^
 [ecj-lint] Resource leak: 'a' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 15. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 76)
 [ecj-lint] 	final MockPKIAuthenticationPlugin mock = new MockPKIAuthenticationPlugin(null, nodeName);
 [ecj-lint] 	                                  ^^^^
 [ecj-lint] Resource leak: 'mock' is never closed
 [ecj-lint] ----------
 [ecj-lint] 16. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 131)
 [ecj-lint] 	MockPKIAuthenticationPlugin mock1 = new MockPKIAuthenticationPlugin(null, nodeName) {
 [ecj-lint] 	                            ^^^^^
 [ecj-lint] Resource leak: 'mock1' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 17. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestRuleBasedAuthorizationPlugin.java (at line 380)
 [ecj-lint] 	RuleBasedAuthorizationPlugin plugin = new RuleBasedAuthorizationPlugin();
 [ecj-lint] 	                             ^^^^^^
 [ecj-lint] Resource leak: 'plugin' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 18. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestSha256AuthenticationProvider.java (at line 49)
 [ecj-lint] 	BasicAuthPlugin basicAuthPlugin = new BasicAuthPlugin();
 [ecj-lint] 	                ^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'basicAuthPlugin' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 19. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/spelling/SimpleQueryConverter.java (at line 42)
 [ecj-lint] 	WhitespaceAnalyzer analyzer = new WhitespaceAnalyzer();
 [ecj-lint] 	                   ^^^^^^^^
 [ecj-lint] Resource leak: 'analyzer' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 20. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 139)
 [ecj-lint] 	IndexWriter w = new IndexWriter(d, newIndexWriterConfig(analyzer));
 [ecj-lint] 	            ^
 [ecj-lint] Resource leak: 'w' is never closed
 [ecj-lint] ----------
 [ecj-lint] 21. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 172)
 [ecj-lint] 	throw iae;
 [ecj-lint] 	^^^^^^^^^^
 [ecj-lint] Resource leak: 'w' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] 22. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 178)
 [ecj-lint] 	return;
 [ecj-lint] 	^^^^^^^
 [ecj-lint] Resource leak: 'w' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 23. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 134)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 24. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 333)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 25. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 367)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 26. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 413)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 27. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 458)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 28. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 516)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 29. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 181)
 [ecj-lint] 	EmbeddedSolrServer server1 = new EmbeddedSolrServer(h.getCoreContainer(), "split1");
 [ecj-lint] 	                   ^^^^^^^
 [ecj-lint] Resource leak: 'server1' is never closed
 [ecj-lint] ----------
 [ecj-lint] 30. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 182)
 [ecj-lint] 	EmbeddedSolrServer server2 = new EmbeddedSolrServer(h.getCoreContainer(), "split2");
 [ecj-lint] 	                   ^^^^^^^
 [ecj-lint] Resource leak: 'server2' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 31. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/processor/RecordingUpdateProcessorFactory.java (at line 67)
 [ecj-lint] 	return recording ? new RecordingUpdateRequestProcessor(commandQueue, next) : next;
 [ecj-lint] 	                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] 31 problems (1 error, 30 warnings)

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:810: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:101: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build.xml:689: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:2013: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:2046: Compile failed; see the compiler error output for details.

Total time: 80 minutes 3 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS-EA] Lucene-Solr-master-Linux (64bit/jdk-9-ea+181) - Build # 20360 - Still unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20360/
Java: 64bit/jdk-9-ea+181 -XX:+UseCompressedOops -XX:+UseSerialGC --illegal-access=deny

1 tests failed.
FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([6589E5DEFB366AFA:3A6DC8E9903AF9BF]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:84)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)




Build Log:
[...truncated 12769 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.metrics.reporters.SolrSlf4jReporterTest_6589E5DEFB366AFA-001/init-core-data-001
   [junit4]   2> 2138503 WARN  (SUITE-SolrSlf4jReporterTest-seed#[6589E5DEFB366AFA]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=6589E5DEFB366AFA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=dje-NE -Dtests.timezone=Pacific/Kosrae -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] FAILURE 6.39s J2 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([6589E5DEFB366AFA:3A6DC8E9903AF9BF]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:84)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   [junit4]    > 	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   [junit4]    > 	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   [junit4]    > 	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
   [junit4]    > 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.metrics.reporters.SolrSlf4jReporterTest_6589E5DEFB366AFA-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1147, maxMBSortInHeap=6.739658647007603, sim=RandomSimilarity(queryNorm=true): {}, locale=dje-NE, timezone=Pacific/Kosrae
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 9 (64-bit)/cpus=8,threads=1,free=237390536,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [UninvertDocValuesMergePolicyTest, TestLegacyNumericRangeQueryBuilder, CdcrVersionReplicationTest, TestIndexSearcher, TestPerFieldSimilarityWithDefaultOverride, TestPivotHelperCode, TestCollectionAPI, TestSimpleQParserPlugin, TestSSLRandomization, MinimalSchemaTest, InfixSuggestersTest, TestCodecSupport, TestLeaderElectionZkExpiry, UtilsToolTest, SolrInfoBeanTest, TestCollationFieldDocValues, TestFieldTypeResource, CursorMarkTest, TestTolerantUpdateProcessorRandomCloud, TestPayloadCheckQParserPlugin, TestSolrCloudWithSecureImpersonation, BadIndexSchemaTest, TestJettySolrRunner, CustomCollectionTest, TestLFUCache, ReturnFieldsTest, SpellCheckCollatorWithCollapseTest, TestSchemaSimilarityResource, TestUniqueKeyFieldResource, TestSort, SolrCLIZkUtilsTest, TestBulkSchemaConcurrent, TestSolrQueryResponse, DistributedFacetPivotLargeTest, TestLegacyTerms, CopyFieldTest, FullSolrCloudDistribCmdsTest, TestSuggestSpellingConverter, SolrMetricManagerTest, TestGroupingSearch, TestConfigSetImmutable, DistributedQueryComponentOptimizationTest, TestUtils, TestLegacyField, TestLMJelinekMercerSimilarityFactory, TestRecovery, TestSubQueryTransformerCrossCore, TestCloudJSONFacetJoinDomain, TestPrepRecovery, TestRestoreCore, SolrTestCaseJ4Test, ConfigSetsAPITest, MigrateRouteKeyTest, BigEndianAscendingWordSerializerTest, XsltUpdateRequestHandlerTest, CdcrUpdateLogTest, AutoCommitTest, TestSimpleTextCodec, TestDistributedMissingSort, TestConfigSetsAPIExclusivity, QueryEqualityTest, StressHdfsTest, LeaderFailureAfterFreshStartTest, NodeMutatorTest, SpellPossibilityIteratorTest, DeleteStatusTest, TestRTimerTree, TestSchemaManager, ReplicationFactorTest, TestClassicSimilarityFactory, TermsComponentTest, TestRecoveryHdfs, ResponseLogComponentTest, SortByFunctionTest, SolrGangliaReporterTest, DocumentBuilderTest, DocValuesMissingTest, TestCustomSort, CachingDirectoryFactoryTest, SolrCoreCheckLockOnStartupTest, TestStressUserVersions, HttpPartitionTest, TestTrie, TestImpersonationWithHadoopAuth, BlockJoinFacetSimpleTest, SuggesterTest, CircularListTest, PathHierarchyTokenizerFactoryTest, BlockCacheTest, TestStressReorder, FastVectorHighlighterTest, TestNamedUpdateProcessors, BJQParserTest, TestRuleBasedAuthorizationPlugin, TestReplicaProperties, TestCollectionAPIs, TestFastWriter, SimplePostToolTest, TestDistributedStatsComponentCardinality, DirectUpdateHandlerTest, TestFieldCacheSortRandom, ClassificationUpdateProcessorIntegrationTest, PolyFieldTest, TestGeoJSONResponseWriter, TestLockTree, TestFieldCollectionResource, TestCopyFieldCollectionResource, TestManagedResourceStorage, UpdateLogTest, TestMacros, CoreAdminRequestStatusTest, TestHdfsUpdateLog, TestStressLiveNodes, TestUseDocValuesAsStored2, AtomicUpdateProcessorFactoryTest, TestDistribIDF, ClusterStateTest, SignatureUpdateProcessorFactoryTest, ChaosMonkeySafeLeaderTest, BasicDistributedZk2Test, UnloadDistributedZkTest, CollectionsAPIDistributedZkTest, OpenCloseCoreStressTest, OverseerTest, LeaderElectionIntegrationTest, BasicZkTest, RecoveryZkTest, LeaderElectionTest, TestZkChroot, TestRandomDVFaceting, TestReload, TestRangeQuery, DisMaxRequestHandlerTest, TestWriterPerf, TestReversedWildcardFilterFactory, TestOmitPositions, RequestHandlersTest, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, RegexBoostProcessorTest, TestJmxIntegration, MBeansHandlerTest, TestStressRecovery, TestSimpleTrackingShardHandler, AsyncCallRequestStatusResponseTest, CdcrReplicationDistributedZkTest, CdcrRequestHandlerTest, CleanupOldIndexTest, CloudExitableDirectoryReaderTest, CollectionReloadTest, CollectionStateFormat2Test, CollectionsAPISolrJTest, DistribJoinFromCollectionTest, DocValuesNotIndexedTest, LeaderInitiatedRecoveryOnCommitTest, OverseerCollectionConfigSetProcessorTest, OverseerModifyCollectionTest, OverseerStatusTest, RollingRestartTest, TestCollectionsAPIViaSolrCloudCluster, TestConfigSetsAPIZkFailure, TestDeleteCollectionOnDownNodes, TestDownShardTolerantSearch, TestHdfsCloudBackupRestore, TestLocalFSCloudBackupRestore, TestOnReconnectListenerSupport, TestSegmentSorting, TestStressInPlaceUpdates, VMParamsZkACLAndCredentialsProvidersTest, HdfsBasicDistributedZk2Test, HdfsBasicDistributedZkTest, HdfsChaosMonkeyNothingIsSafeTest, HdfsChaosMonkeySafeLeaderTest, HdfsCollectionsAPIDistributedZkTest, HdfsNNFailoverTest, HdfsRecoveryZkTest, QueryResultKeyTest, TestCorePropertiesReload, TestImplicitCoreProperties, TestInfoStreamLogging, TestNRTOpen, TestSolrCoreSnapshots, TestHdfsBackupRestoreCore, TestSystemCollAutoCreate, MetricsHandlerTest, SegmentsInfoRequestHandlerTest, TestApiFramework, TestConfigsApi, TestCoreAdminApis, DistributedDebugComponentTest, DistributedFacetExistsSmallTest, DistributedFacetPivotWhiteBoxTest, FacetPivotSmallTest, TestHttpShardHandlerFactory, TestTrackingShardHandlerFactory, TestLegacyFieldReuse, TestNumericRangeQuery32, TestNumericRangeQuery64, JvmMetricsTest, SolrSlf4jReporterTest]
   [junit4] Completed [625/731 (1!)] on J2 in 6.42s, 1 test, 1 failure <<< FAILURES!

[...truncated 36871 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20359 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20359/
Java: 64bit/jdk1.8.0_144 -XX:-UseCompressedOops -XX:+UseG1GC

1 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Doc with id=1 not found in http://127.0.0.1:44829/_jg/q/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:44829/_jg/q/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([168542E7C10F0BFB:9ED17D3D6FF36603]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12273 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> 2035256 INFO  (SUITE-HttpPartitionTest-seed#[168542E7C10F0BFB]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/init-core-data-001
   [junit4]   2> 2035257 INFO  (SUITE-HttpPartitionTest-seed#[168542E7C10F0BFB]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2035257 INFO  (SUITE-HttpPartitionTest-seed#[168542E7C10F0BFB]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 2035257 INFO  (SUITE-HttpPartitionTest-seed#[168542E7C10F0BFB]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /_jg/q
   [junit4]   2> 2035259 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2035259 INFO  (Thread-7733) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2035259 INFO  (Thread-7733) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2035260 ERROR (Thread-7733) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2035359 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.ZkTestServer start zk server on port:35735
   [junit4]   2> 2035366 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 2035366 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 2035367 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 2035367 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 2035368 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 2035368 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 2035368 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 2035369 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 2035369 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 2035369 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 2035370 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 2035370 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 2035420 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2035421 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@33543f0a{/_jg/q,null,AVAILABLE}
   [junit4]   2> 2035422 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1ff0ac5d{HTTP/1.1,[http/1.1]}{127.0.0.1:44969}
   [junit4]   2> 2035422 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.Server Started @2037473ms
   [junit4]   2> 2035422 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/tempDir-001/control/data, hostContext=/_jg/q, hostPort=44829, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/control-001/cores}
   [junit4]   2> 2035422 ERROR (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2035422 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2035422 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2035422 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2035422 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T18:25:36.544Z
   [junit4]   2> 2035426 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2035426 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/control-001/solr.xml
   [junit4]   2> 2035429 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2035430 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35735/solr
   [junit4]   2> 2035453 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2035453 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:44829__jg%2Fq
   [junit4]   2> 2035453 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.Overseer Overseer (id=98528548381130756-127.0.0.1:44829__jg%2Fq-n_0000000000) starting
   [junit4]   2> 2035455 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44829__jg%2Fq
   [junit4]   2> 2035455 INFO  (zkCallback-3180-thread-1-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2035494 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2035500 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2035500 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2035501 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/control-001/cores
   [junit4]   2> 2035512 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2035513 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35735/solr ready
   [junit4]   2> 2035513 INFO  (SocketProxy-Acceptor-44829) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=41186,localport=44829], receiveBufferSize:531000
   [junit4]   2> 2035513 INFO  (SocketProxy-Acceptor-44829) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44969,localport=37452], receiveBufferSize=530904
   [junit4]   2> 2035513 INFO  (qtp1137177561-22639) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44829__jg%252Fq&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2035514 INFO  (OverseerThreadFactory-8544-thread-1-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 2035617 INFO  (SocketProxy-Acceptor-44829) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=41190,localport=44829], receiveBufferSize:531000
   [junit4]   2> 2035617 INFO  (SocketProxy-Acceptor-44829) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44969,localport=37456], receiveBufferSize=530904
   [junit4]   2> 2035617 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 2035617 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2035720 INFO  (zkCallback-3180-thread-1-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2036625 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2036634 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 2036741 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2036759 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 2036760 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2036760 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2036760 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 2036764 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=9.40625, floorSegmentMB=1.55078125, forceMergeDeletesPctAllowed=14.678975364956953, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6553940157080618
   [junit4]   2> 2036768 WARN  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2036814 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2036814 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2036816 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2036817 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2036819 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.27233139108897464]
   [junit4]   2> 2036820 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@12f71bf4[control_collection_shard1_replica_n1] main]
   [junit4]   2> 2036821 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2036821 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2036822 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 2036822 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576456775735967744
   [junit4]   2> 2036825 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2036826 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2036826 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44829/_jg/q/control_collection_shard1_replica_n1/
   [junit4]   2> 2036826 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2036826 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:44829/_jg/q/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 2036826 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2036842 INFO  (searcherExecutor-8547-thread-1-processing-n:127.0.0.1:44829__jg%2Fq x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@12f71bf4[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2036843 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44829/_jg/q/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 2036945 INFO  (zkCallback-3180-thread-1-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2036993 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2037013 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1395
   [junit4]   2> 2037015 INFO  (qtp1137177561-22639) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 2037116 INFO  (zkCallback-3180-thread-1-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 2037516 INFO  (OverseerCollectionConfigSetProcessor-98528548381130756-127.0.0.1:44829__jg%2Fq-n_0000000000) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2038016 INFO  (qtp1137177561-22639) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:44829__jg%252Fq&wt=javabin&version=2} status=0 QTime=2502
   [junit4]   2> 2038023 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2038024 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:35735/solr ready
   [junit4]   2> 2038024 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 2038024 INFO  (SocketProxy-Acceptor-44829) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=41208,localport=44829], receiveBufferSize:531000
   [junit4]   2> 2038026 INFO  (SocketProxy-Acceptor-44829) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44969,localport=37474], receiveBufferSize=530904
   [junit4]   2> 2038026 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2038028 INFO  (OverseerThreadFactory-8544-thread-2-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 2038028 WARN  (OverseerThreadFactory-8544-thread-2-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 2038230 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 2038230 INFO  (qtp1137177561-22641) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=204
   [junit4]   2> 2038322 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-1-001 of type TLOG
   [junit4]   2> 2038323 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2038324 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@222c90a{/_jg/q,null,AVAILABLE}
   [junit4]   2> 2038324 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@55bd721a{HTTP/1.1,[http/1.1]}{127.0.0.1:44749}
   [junit4]   2> 2038324 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.Server Started @2040376ms
   [junit4]   2> 2038325 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/_jg/q, hostPort=46843, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-1-001/cores}
   [junit4]   2> 2038325 ERROR (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2038325 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2038325 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2038325 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2038325 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T18:25:39.447Z
   [junit4]   2> 2038327 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2038327 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-1-001/solr.xml
   [junit4]   2> 2038331 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2038334 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35735/solr
   [junit4]   2> 2038339 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2038340 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2038341 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46843__jg%2Fq
   [junit4]   2> 2038342 INFO  (zkCallback-3180-thread-2-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2038342 INFO  (zkCallback-3187-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2038342 INFO  (zkCallback-3192-thread-1-processing-n:127.0.0.1:46843__jg%2Fq) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2038392 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2038399 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2038399 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2038400 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-1-001/cores
   [junit4]   2> 2038415 INFO  (SocketProxy-Acceptor-46843) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=45662,localport=46843], receiveBufferSize:531000
   [junit4]   2> 2038415 INFO  (SocketProxy-Acceptor-46843) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44749,localport=42246], receiveBufferSize=530904
   [junit4]   2> 2038416 INFO  (qtp1353016925-22688) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46843__jg%252Fq&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2038417 INFO  (OverseerCollectionConfigSetProcessor-98528548381130756-127.0.0.1:44829__jg%2Fq-n_0000000000) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2038417 INFO  (OverseerThreadFactory-8544-thread-3-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:46843__jg%2Fq for creating new replica
   [junit4]   2> 2038417 INFO  (SocketProxy-Acceptor-46843) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=45666,localport=46843], receiveBufferSize:531000
   [junit4]   2> 2038418 INFO  (SocketProxy-Acceptor-46843) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44749,localport=42250], receiveBufferSize=530904
   [junit4]   2> 2038418 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 2038418 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2038520 INFO  (zkCallback-3192-thread-1-processing-n:127.0.0.1:46843__jg%2Fq) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2039429 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2039437 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
   [junit4]   2> 2039514 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2039520 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
   [junit4]   2> 2039520 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2039520 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2039520 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
   [junit4]   2> 2039521 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=9.40625, floorSegmentMB=1.55078125, forceMergeDeletesPctAllowed=14.678975364956953, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6553940157080618
   [junit4]   2> 2039523 WARN  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2039544 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2039544 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2039545 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2039545 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2039546 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.27233139108897464]
   [junit4]   2> 2039546 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@2198acaf[collection1_shard2_replica_t41] main]
   [junit4]   2> 2039547 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2039547 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2039547 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 2039548 INFO  (searcherExecutor-8558-thread-1-processing-n:127.0.0.1:46843__jg%2Fq x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@2198acaf[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2039548 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576456778594385920
   [junit4]   2> 2039552 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2039552 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2039552 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46843/_jg/q/collection1_shard2_replica_t41/
   [junit4]   2> 2039552 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2039552 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:46843/_jg/q/collection1_shard2_replica_t41/ has no replicas
   [junit4]   2> 2039552 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2039552 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
   [junit4]   2> 2039553 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46843/_jg/q/collection1_shard2_replica_t41/ shard2
   [junit4]   2> 2039654 INFO  (zkCallback-3192-thread-1-processing-n:127.0.0.1:46843__jg%2Fq) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 2039704 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2039705 INFO  (qtp1353016925-22690) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1287
   [junit4]   2> 2039706 INFO  (qtp1353016925-22688) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46843__jg%252Fq&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1290
   [junit4]   2> 2039765 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-2-001 of type TLOG
   [junit4]   2> 2039766 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2039766 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3562fa8d{/_jg/q,null,AVAILABLE}
   [junit4]   2> 2039767 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@2b37398a{HTTP/1.1,[http/1.1]}{127.0.0.1:41459}
   [junit4]   2> 2039767 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.Server Started @2041818ms
   [junit4]   2> 2039767 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/_jg/q, hostPort=36489, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-2-001/cores}
   [junit4]   2> 2039767 ERROR (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2039767 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2039767 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2039767 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2039767 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T18:25:40.889Z
   [junit4]   2> 2039769 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2039769 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-2-001/solr.xml
   [junit4]   2> 2039771 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2039773 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35735/solr
   [junit4]   2> 2039777 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2039778 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2039778 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36489__jg%2Fq
   [junit4]   2> 2039779 INFO  (zkCallback-3192-thread-1-processing-n:127.0.0.1:46843__jg%2Fq) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2039779 INFO  (zkCallback-3180-thread-2-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2039779 INFO  (zkCallback-3187-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2039779 INFO  (zkCallback-3198-thread-1-processing-n:127.0.0.1:36489__jg%2Fq) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2039818 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2039854 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2039855 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2039856 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-2-001/cores
   [junit4]   2> 2039879 INFO  (SocketProxy-Acceptor-36489) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=56676,localport=36489], receiveBufferSize:531000
   [junit4]   2> 2039881 INFO  (zkCallback-3192-thread-1-processing-n:127.0.0.1:46843__jg%2Fq) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2039882 INFO  (SocketProxy-Acceptor-36489) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=41459,localport=41930], receiveBufferSize=530904
   [junit4]   2> 2039883 INFO  (qtp1264010015-22722) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:36489__jg%252Fq&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2039884 INFO  (OverseerCollectionConfigSetProcessor-98528548381130756-127.0.0.1:44829__jg%2Fq-n_0000000000) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2039884 INFO  (OverseerThreadFactory-8544-thread-4-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:36489__jg%2Fq for creating new replica
   [junit4]   2> 2039886 INFO  (SocketProxy-Acceptor-36489) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=56680,localport=36489], receiveBufferSize:531000
   [junit4]   2> 2039886 INFO  (SocketProxy-Acceptor-36489) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=41459,localport=41934], receiveBufferSize=530904
   [junit4]   2> 2039887 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 2039888 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2039994 INFO  (zkCallback-3192-thread-1-processing-n:127.0.0.1:46843__jg%2Fq) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2039994 INFO  (zkCallback-3198-thread-1-processing-n:127.0.0.1:36489__jg%2Fq) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2040898 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2040908 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
   [junit4]   2> 2040989 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2040998 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
   [junit4]   2> 2040998 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2040998 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2040998 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
   [junit4]   2> 2041000 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=9.40625, floorSegmentMB=1.55078125, forceMergeDeletesPctAllowed=14.678975364956953, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6553940157080618
   [junit4]   2> 2041002 WARN  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2041026 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2041026 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2041027 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2041027 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2041028 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.27233139108897464]
   [junit4]   2> 2041028 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@6b6257ad[collection1_shard1_replica_t43] main]
   [junit4]   2> 2041029 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2041029 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2041030 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 2041030 INFO  (searcherExecutor-8569-thread-1-processing-n:127.0.0.1:36489__jg%2Fq x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@6b6257ad[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2041031 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576456780149424128
   [junit4]   2> 2041034 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2041034 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2041034 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36489/_jg/q/collection1_shard1_replica_t43/
   [junit4]   2> 2041034 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 2041034 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:36489/_jg/q/collection1_shard1_replica_t43/ has no replicas
   [junit4]   2> 2041034 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2041034 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
   [junit4]   2> 2041035 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36489/_jg/q/collection1_shard1_replica_t43/ shard1
   [junit4]   2> 2041137 INFO  (zkCallback-3192-thread-1-processing-n:127.0.0.1:46843__jg%2Fq) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2041137 INFO  (zkCallback-3198-thread-1-processing-n:127.0.0.1:36489__jg%2Fq) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 2041186 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2041187 INFO  (qtp1264010015-22724) [n:127.0.0.1:36489__jg%2Fq c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1299
   [junit4]   2> 2041188 INFO  (qtp1264010015-22722) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:36489__jg%252Fq&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1304
   [junit4]   2> 2041244 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-3-001 of type TLOG
   [junit4]   2> 2041244 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2041245 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@42d80f68{/_jg/q,null,AVAILABLE}
   [junit4]   2> 2041245 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@927dfe{HTTP/1.1,[http/1.1]}{127.0.0.1:44143}
   [junit4]   2> 2041245 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.e.j.s.Server Started @2043297ms
   [junit4]   2> 2041245 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/_jg/q, hostPort=40683, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-3-001/cores}
   [junit4]   2> 2041245 ERROR (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2041245 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2041245 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2041245 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2041245 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T18:25:42.367Z
   [junit4]   2> 2041247 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 2041247 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-3-001/solr.xml
   [junit4]   2> 2041250 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2041251 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:35735/solr
   [junit4]   2> 2041255 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2041256 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2041256 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:40683__jg%2Fq
   [junit4]   2> 2041257 INFO  (zkCallback-3187-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2041257 INFO  (zkCallback-3198-thread-1-processing-n:127.0.0.1:36489__jg%2Fq) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2041257 INFO  (zkCallback-3192-thread-1-processing-n:127.0.0.1:46843__jg%2Fq) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2041257 INFO  (zkCallback-3180-thread-1-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2041257 INFO  (zkCallback-3204-thread-1-processing-n:127.0.0.1:40683__jg%2Fq) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2041317 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2041324 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2041324 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2041325 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-3-001/cores
   [junit4]   2> 2041357 INFO  (zkCallback-3192-thread-1-processing-n:127.0.0.1:46843__jg%2Fq) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2041357 INFO  (zkCallback-3198-thread-1-processing-n:127.0.0.1:36489__jg%2Fq) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2041373 INFO  (qtp1264010015-22723) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:40683__jg%252Fq&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2041374 INFO  (OverseerCollectionConfigSetProcessor-98528548381130756-127.0.0.1:44829__jg%2Fq-n_0000000000) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2041374 INFO  (OverseerThreadFactory-8544-thread-5-processing-n:127.0.0.1:44829__jg%2Fq) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:40683__jg%2Fq for creating new replica
   [junit4]   2> 2041375 INFO  (SocketProxy-Acceptor-40683) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=49148,localport=40683], receiveBufferSize:531000
   [junit4]   2> 2041375 INFO  (SocketProxy-Acceptor-40683) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44143,localport=36544], receiveBufferSize=530904
   [junit4]   2> 2041375 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 2041376 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 2041478 INFO  (zkCallback-3198-thread-1-processing-n:127.0.0.1:36489__jg%2Fq) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2041478 INFO  (zkCallback-3192-thread-1-processing-n:127.0.0.1:46843__jg%2Fq) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2041478 INFO  (zkCallback-3204-thread-1-processing-n:127.0.0.1:40683__jg%2Fq) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2042384 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2042395 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
   [junit4]   2> 2042509 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2042518 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
   [junit4]   2> 2042518 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@410b3c5
   [junit4]   2> 2042519 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2042519 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_168542E7C10F0BFB-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
   [junit4]   2> 2042521 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=14, maxMergeAtOnceExplicit=40, maxMergedSegmentMB=9.40625, floorSegmentMB=1.55078125, forceMergeDeletesPctAllowed=14.678975364956953, segmentsPerTier=20.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.6553940157080618
   [junit4]   2> 2042523 WARN  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 2042553 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2042553 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2042577 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2042577 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2042578 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=38, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.27233139108897464]
   [junit4]   2> 2042579 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@5ff4980f[collection1_shard2_replica_t45] main]
   [junit4]   2> 2042581 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 2042581 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 2042582 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 2042583 INFO  (searcherExecutor-8580-thread-1-processing-n:127.0.0.1:40683__jg%2Fq x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@5ff4980f[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2042583 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576456781776814080
   [junit4]   2> 2042585 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
   [junit4]   2> 2042586 INFO  (updateExecutor-3201-thread-1-processing-n:127.0.0.1:40683__jg%2Fq x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 2042586 INFO  (qtp1238269002-22756) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1210
   [junit4]   2> 2042605 INFO  (qtp1264010015-22723) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:40683__jg%252Fq&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1231
   [junit4]   2> 2042606 INFO  (recoveryExecutor-3202-thread-1-processing-n:127.0.0.1:40683__jg%2Fq x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 2042606 INFO  (recoveryExecutor-3202-thread-1-processing-n:127.0.0.1:40683__jg%2Fq x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 2042606 INFO  (recoveryExecutor-3202-thread-1-processing-n:127.0.0.1:40683__jg%2Fq x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
   [junit4]   2> 2042606 INFO  (recoveryExecutor-3202-thread-1-processing-n:127.0.0.1:40683__jg%2Fq x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
   [junit4]   2> 2042606 INFO  (recoveryExecutor-3202-thread-1-processing-n:127.0.0.1:40683__jg%2Fq x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 2042606 INFO  (recoveryExecutor-3202-thread-1-processing-n:127.0.0.1:40683__jg%2Fq x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:46843/_jg/q/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:40683/_jg/q/collection1_shard2_replica_t45/]
   [junit4]   2> 2042611 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 2042611 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Wait for recoveries to finish - wait 30000 for each attempt
   [junit4]   2> 2042611 INFO  (TEST-HttpPartitionTest.test-seed#[168542E7C10F0BFB]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30000
   [junit4]   2> 2042618 INFO  (recoveryExecutor-3202-thread-1-processing-n:127.0.0.1:40683__jg%2Fq x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:46843/_jg/q]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:40683__jg%252Fq&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 2042618 INFO  (SocketProxy-Acceptor-46843) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=45720,localport=46843], receiveBufferSize:531000
   [junit4]   2> 2042619 INFO  (SocketProxy-Acceptor-46843) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44749,localport=42304], receiveBufferSize=530904
   [junit4]   2> 2042619 INFO  (qtp1353016925-22685) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 2042619 INFO  (qtp1353016925-22685) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:40683__jg%2Fq, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:40683/_jg/q","node_name":"127.0.0.1:40683__jg%2Fq","state":"down","type":"TLOG"}
   [junit4]   2> 2042709 INFO  (zkCallback-3192-thread-1-processing-n:127.0.0.1:46843__jg%2Fq) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2042709 INFO  (zkCallback-3198-thread-1-processing-n:127.0.0.1:36489__jg%2Fq) [n:127.0.0.1:36489__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2042709 INFO  (zkCallback-3204-thread-1-processing-n:127.0.0.1:40683__jg%2Fq) [n:127.0.0.1:40683__jg%2Fq    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 2043375 INFO  (OverseerCollectionConfigSetProcessor-98528548381130756-127.0.0.1:44829__jg%2Fq-n_0000000000) [n:127.0.0.1:44829__jg%2Fq    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2043619 INFO  (qtp1353016925-22685) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:40683__jg%2Fq, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:40683/_jg/q","node_name":"127.0.0.1:40683__jg%2Fq","state":"recovering","type":"TLOG"}
   [junit4]   2> 2043620 INFO  (qtp1353016925-22685) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
   [junit4]   2> 2043620 INFO  (qtp1353016925-22685) [n:127.0.0.1:46843__jg%2Fq    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:40683__jg%252Fq&onlyIfLeaderActive=true&core=collection1_shard2_replica_t41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1000
   [junit4]   2> 2044120 INFO  (recoveryExecutor-3202-thread-1-processing-n:127.0.0.1:40683__jg%2Fq x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
   [junit4]   2> 2044120 INFO  (recoveryExecutor-3202-thread-1-processing-n:127.0.0.1:40683__jg%2Fq x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:40683__jg%2Fq c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Attempting to replicate from [http://127.0.0.1:46843/_jg/q/collection1_shard2_replica_t41/].
   [junit4]   2> 2044121 INFO  (SocketProxy-Acceptor-46843) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=45724,localport=46843], receiveBufferSize:531000
   [junit4]   2> 2044122 INFO  (qtp1353016925-22685) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576456783390572544,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2044122 INFO  (qtp1353016925-22685) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 2044122 INFO  (SocketProxy-Acceptor-46843) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=44749,localport=42308], receiveBufferSize=530904
   [junit4]   2> 2044122 INFO  (qtp1353016925-22685) [n:127.0.0.1:46843__jg%2Fq c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2044122 INFO  (qtp1353016925-22685) [n:127.0.0.

[...truncated too long message...]

sed
 [ecj-lint] ----------
 [ecj-lint] 8. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/handler/component/DistributedDebugComponentTest.java (at line 221)
 [ecj-lint] 	throw new AssertionError(q.toString() + ": " + e.getMessage(), e);
 [ecj-lint] 	^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'client' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 9. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 204)
 [ecj-lint] 	Analyzer a1 = new WhitespaceAnalyzer();
 [ecj-lint] 	         ^^
 [ecj-lint] Resource leak: 'a1' is never closed
 [ecj-lint] ----------
 [ecj-lint] 10. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 207)
 [ecj-lint] 	OffsetWindowTokenFilter tots = new OffsetWindowTokenFilter(tokenStream);
 [ecj-lint] 	                        ^^^^
 [ecj-lint] Resource leak: 'tots' is never closed
 [ecj-lint] ----------
 [ecj-lint] 11. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/highlight/HighlighterTest.java (at line 211)
 [ecj-lint] 	Analyzer a2 = new WhitespaceAnalyzer();
 [ecj-lint] 	         ^^
 [ecj-lint] Resource leak: 'a2' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 12. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/response/TestJavabinTupleStreamParser.java (at line 72)
 [ecj-lint] 	JavabinTupleStreamParser parser = new JavabinTupleStreamParser(new ByteArrayInputStream(bytes), true);
 [ecj-lint] 	                         ^^^^^^
 [ecj-lint] Resource leak: 'parser' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 13. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 243)
 [ecj-lint] 	return loadfactor!=0 ? new HashDocSet(a,0,n,1/loadfactor) : new HashDocSet(a,0,n);
 [ecj-lint] 	                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] 14. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/search/TestDocSet.java (at line 528)
 [ecj-lint] 	DocSet a = new BitDocSet(bs);
 [ecj-lint] 	       ^
 [ecj-lint] Resource leak: 'a' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 15. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 76)
 [ecj-lint] 	final MockPKIAuthenticationPlugin mock = new MockPKIAuthenticationPlugin(null, nodeName);
 [ecj-lint] 	                                  ^^^^
 [ecj-lint] Resource leak: 'mock' is never closed
 [ecj-lint] ----------
 [ecj-lint] 16. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestPKIAuthenticationPlugin.java (at line 131)
 [ecj-lint] 	MockPKIAuthenticationPlugin mock1 = new MockPKIAuthenticationPlugin(null, nodeName) {
 [ecj-lint] 	                            ^^^^^
 [ecj-lint] Resource leak: 'mock1' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 17. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestRuleBasedAuthorizationPlugin.java (at line 380)
 [ecj-lint] 	RuleBasedAuthorizationPlugin plugin = new RuleBasedAuthorizationPlugin();
 [ecj-lint] 	                             ^^^^^^
 [ecj-lint] Resource leak: 'plugin' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 18. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/security/TestSha256AuthenticationProvider.java (at line 49)
 [ecj-lint] 	BasicAuthPlugin basicAuthPlugin = new BasicAuthPlugin();
 [ecj-lint] 	                ^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: 'basicAuthPlugin' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 19. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/spelling/SimpleQueryConverter.java (at line 42)
 [ecj-lint] 	WhitespaceAnalyzer analyzer = new WhitespaceAnalyzer();
 [ecj-lint] 	                   ^^^^^^^^
 [ecj-lint] Resource leak: 'analyzer' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 20. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 139)
 [ecj-lint] 	IndexWriter w = new IndexWriter(d, newIndexWriterConfig(analyzer));
 [ecj-lint] 	            ^
 [ecj-lint] Resource leak: 'w' is never closed
 [ecj-lint] ----------
 [ecj-lint] 21. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 172)
 [ecj-lint] 	throw iae;
 [ecj-lint] 	^^^^^^^^^^
 [ecj-lint] Resource leak: 'w' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] 22. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/uninverting/TestFieldCacheVsDocValues.java (at line 178)
 [ecj-lint] 	return;
 [ecj-lint] 	^^^^^^^
 [ecj-lint] Resource leak: 'w' is not closed at this location
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 23. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 134)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 24. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 333)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 25. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 367)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 26. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 413)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(streamingClients, 5, 0);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 27. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 458)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] 28. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrCmdDistributorTest.java (at line 516)
 [ecj-lint] 	SolrCmdDistributor cmdDistrib = new SolrCmdDistributor(updateShardHandler);
 [ecj-lint] 	                   ^^^^^^^^^^
 [ecj-lint] Resource leak: 'cmdDistrib' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 29. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 181)
 [ecj-lint] 	EmbeddedSolrServer server1 = new EmbeddedSolrServer(h.getCoreContainer(), "split1");
 [ecj-lint] 	                   ^^^^^^^
 [ecj-lint] Resource leak: 'server1' is never closed
 [ecj-lint] ----------
 [ecj-lint] 30. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/SolrIndexSplitterTest.java (at line 182)
 [ecj-lint] 	EmbeddedSolrServer server2 = new EmbeddedSolrServer(h.getCoreContainer(), "split2");
 [ecj-lint] 	                   ^^^^^^^
 [ecj-lint] Resource leak: 'server2' is never closed
 [ecj-lint] ----------
 [ecj-lint] ----------
 [ecj-lint] 31. WARNING in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test/org/apache/solr/update/processor/RecordingUpdateProcessorFactory.java (at line 67)
 [ecj-lint] 	return recording ? new RecordingUpdateRequestProcessor(commandQueue, next) : next;
 [ecj-lint] 	                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
 [ecj-lint] Resource leak: '<unassigned Closeable value>' is never closed
 [ecj-lint] ----------
 [ecj-lint] 31 problems (1 error, 30 warnings)

BUILD FAILED
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:810: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/build.xml:101: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build.xml:689: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:2013: The following error occurred while executing this line:
/home/jenkins/workspace/Lucene-Solr-master-Linux/lucene/common-build.xml:2046: Compile failed; see the compiler error output for details.

Total time: 79 minutes 26 seconds
Build step 'Invoke Ant' marked build as failure
Archiving artifacts
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20358 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20358/
Java: 32bit/jdk1.8.0_144 -client -XX:+UseSerialGC

2 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Doc with id=1 not found in http://127.0.0.1:35321/xh/p/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:35321/xh/p/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([81332594CF3169AA:9671A4E61CD0452]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)


FAILED:  org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter

Error Message:


Stack Trace:
java.lang.AssertionError
	at __randomizedtesting.SeedInfo.seed([81332594CF3169AA:DED708A3A43DFAEF]:0)
	at org.junit.Assert.fail(Assert.java:92)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.junit.Assert.assertTrue(Assert.java:54)
	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:74)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 11053 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> 433685 INFO  (SUITE-HttpPartitionTest-seed#[81332594CF3169AA]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/init-core-data-001
   [junit4]   2> 433685 WARN  (SUITE-HttpPartitionTest-seed#[81332594CF3169AA]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=7 numCloses=7
   [junit4]   2> 433686 INFO  (SUITE-HttpPartitionTest-seed#[81332594CF3169AA]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 433687 INFO  (SUITE-HttpPartitionTest-seed#[81332594CF3169AA]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 433687 INFO  (SUITE-HttpPartitionTest-seed#[81332594CF3169AA]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /xh/p
   [junit4]   2> 433688 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 433688 INFO  (Thread-527) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 433688 INFO  (Thread-527) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 433690 ERROR (Thread-527) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 433788 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.ZkTestServer start zk server on port:37945
   [junit4]   2> 433804 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 433806 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 433808 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 433809 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 433811 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 433812 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 433813 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 433814 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 433816 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 433817 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 433818 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 433821 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 433913 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 433914 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1160399{/xh/p,null,AVAILABLE}
   [junit4]   2> 433914 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@daff9e{HTTP/1.1,[http/1.1]}{127.0.0.1:37691}
   [junit4]   2> 433915 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.Server Started @434851ms
   [junit4]   2> 433915 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/tempDir-001/control/data, replicaType=NRT, hostContext=/xh/p, hostPort=37257, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/control-001/cores}
   [junit4]   2> 433915 ERROR (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 433915 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 433915 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 433915 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 433915 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T11:59:30.481Z
   [junit4]   2> 433917 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 433917 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/control-001/solr.xml
   [junit4]   2> 433923 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 433925 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37945/solr
   [junit4]   2> 433957 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 433957 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37257_xh%2Fp
   [junit4]   2> 433958 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.Overseer Overseer (id=98527030165831684-127.0.0.1:37257_xh%2Fp-n_0000000000) starting
   [junit4]   2> 433960 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37257_xh%2Fp
   [junit4]   2> 433962 INFO  (zkCallback-380-thread-1-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 434230 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 434240 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 434240 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 434241 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/control-001/cores
   [junit4]   2> 434271 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 434272 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37945/solr ready
   [junit4]   2> 434272 INFO  (SocketProxy-Acceptor-37257) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=60612,localport=37257], receiveBufferSize:531000
   [junit4]   2> 434272 INFO  (SocketProxy-Acceptor-37257) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=37691,localport=56808], receiveBufferSize=530904
   [junit4]   2> 434273 INFO  (qtp21575158-2590) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37257_xh%252Fp&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 434275 INFO  (OverseerThreadFactory-970-thread-1-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 434382 INFO  (SocketProxy-Acceptor-37257) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=60616,localport=37257], receiveBufferSize:531000
   [junit4]   2> 434382 INFO  (SocketProxy-Acceptor-37257) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=37691,localport=56812], receiveBufferSize=530904
   [junit4]   2> 434382 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 434383 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 434486 INFO  (zkCallback-380-thread-1-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 435398 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 435433 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 435528 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 435549 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 435550 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 435550 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 435550 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 435553 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 435555 WARN  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 435594 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 435594 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 435595 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 435595 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 435605 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=1.6982421875, floorSegmentMB=1.0224609375, forceMergeDeletesPctAllowed=24.595564567763446, segmentsPerTier=36.0, maxCFSSegmentSizeMB=0.6201171875, noCFSRatio=0.20630070084716712
   [junit4]   2> 435605 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@17509ae[control_collection_shard1_replica_n1] main]
   [junit4]   2> 435606 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 435606 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 435607 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 435607 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576432484664475648
   [junit4]   2> 435610 INFO  (searcherExecutor-973-thread-1-processing-n:127.0.0.1:37257_xh%2Fp x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@17509ae[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 435620 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 435620 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 435620 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:37257/xh/p/control_collection_shard1_replica_n1/
   [junit4]   2> 435620 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 435620 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:37257/xh/p/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 435620 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 435621 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:37257/xh/p/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 435723 INFO  (zkCallback-380-thread-1-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 435772 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 435773 INFO  (qtp21575158-2586) [n:127.0.0.1:37257_xh%2Fp c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1391
   [junit4]   2> 435776 INFO  (qtp21575158-2590) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 435876 INFO  (zkCallback-380-thread-1-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 436277 INFO  (OverseerCollectionConfigSetProcessor-98527030165831684-127.0.0.1:37257_xh%2Fp-n_0000000000) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 436776 INFO  (qtp21575158-2590) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:37257_xh%252Fp&wt=javabin&version=2} status=0 QTime=2503
   [junit4]   2> 436781 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 436782 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:37945/solr ready
   [junit4]   2> 436782 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 436782 INFO  (SocketProxy-Acceptor-37257) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=60640,localport=37257], receiveBufferSize:531000
   [junit4]   2> 436783 INFO  (SocketProxy-Acceptor-37257) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=37691,localport=56836], receiveBufferSize=530904
   [junit4]   2> 436783 INFO  (qtp21575158-2587) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 436785 INFO  (OverseerThreadFactory-970-thread-2-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 436785 WARN  (OverseerThreadFactory-970-thread-2-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 436988 INFO  (qtp21575158-2587) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 436988 INFO  (qtp21575158-2587) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=205
   [junit4]   2> 437060 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-1-001 of type TLOG
   [junit4]   2> 437060 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 437061 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1996c63{/xh/p,null,AVAILABLE}
   [junit4]   2> 437061 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@151807a{HTTP/1.1,[http/1.1]}{127.0.0.1:35763}
   [junit4]   2> 437061 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.Server Started @437998ms
   [junit4]   2> 437061 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/xh/p, hostPort=44687, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-1-001/cores}
   [junit4]   2> 437062 ERROR (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 437062 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 437062 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 437062 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 437062 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T11:59:33.628Z
   [junit4]   2> 437064 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 437064 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-1-001/solr.xml
   [junit4]   2> 437070 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 437073 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37945/solr
   [junit4]   2> 437079 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 437079 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 437080 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44687_xh%2Fp
   [junit4]   2> 437081 INFO  (zkCallback-387-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 437081 INFO  (zkCallback-380-thread-1-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 437082 INFO  (zkCallback-392-thread-1-processing-n:127.0.0.1:44687_xh%2Fp) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 437309 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 437321 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 437321 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 437322 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-1-001/cores
   [junit4]   2> 437356 INFO  (qtp21575158-2590) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:44687_xh%252Fp&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 437358 INFO  (OverseerCollectionConfigSetProcessor-98527030165831684-127.0.0.1:37257_xh%2Fp-n_0000000000) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 437358 INFO  (OverseerThreadFactory-970-thread-3-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:44687_xh%2Fp for creating new replica
   [junit4]   2> 437359 INFO  (SocketProxy-Acceptor-44687) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=53026,localport=44687], receiveBufferSize:531000
   [junit4]   2> 437360 INFO  (SocketProxy-Acceptor-44687) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35763,localport=40380], receiveBufferSize=530904
   [junit4]   2> 437360 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 437361 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 437464 INFO  (zkCallback-392-thread-1-processing-n:127.0.0.1:44687_xh%2Fp) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 438384 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 438401 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
   [junit4]   2> 438486 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 438501 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
   [junit4]   2> 438501 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 438501 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 438502 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
   [junit4]   2> 438504 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 438506 WARN  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 438539 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 438539 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 438540 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 438540 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 438541 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=1.6982421875, floorSegmentMB=1.0224609375, forceMergeDeletesPctAllowed=24.595564567763446, segmentsPerTier=36.0, maxCFSSegmentSizeMB=0.6201171875, noCFSRatio=0.20630070084716712
   [junit4]   2> 438541 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@1d4905a[collection1_shard2_replica_t41] main]
   [junit4]   2> 438542 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 438543 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 438543 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 438543 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576432487743094784
   [junit4]   2> 438553 INFO  (searcherExecutor-984-thread-1-processing-n:127.0.0.1:44687_xh%2Fp x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@1d4905a[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 438555 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 438555 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 438555 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44687/xh/p/collection1_shard2_replica_t41/
   [junit4]   2> 438555 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 438555 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:44687/xh/p/collection1_shard2_replica_t41/ has no replicas
   [junit4]   2> 438555 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 438556 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
   [junit4]   2> 438557 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44687/xh/p/collection1_shard2_replica_t41/ shard2
   [junit4]   2> 438659 INFO  (zkCallback-392-thread-1-processing-n:127.0.0.1:44687_xh%2Fp) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 438708 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 438709 INFO  (qtp13401326-2638) [n:127.0.0.1:44687_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1349
   [junit4]   2> 438711 INFO  (qtp21575158-2590) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:44687_xh%252Fp&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1354
   [junit4]   2> 438776 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-2-001 of type TLOG
   [junit4]   2> 438776 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 438777 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@eb9218{/xh/p,null,AVAILABLE}
   [junit4]   2> 438777 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@18f8ada{HTTP/1.1,[http/1.1]}{127.0.0.1:37767}
   [junit4]   2> 438777 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.Server Started @439714ms
   [junit4]   2> 438777 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/xh/p, hostPort=45341, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-2-001/cores}
   [junit4]   2> 438778 ERROR (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 438778 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 438778 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 438778 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 438778 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T11:59:35.344Z
   [junit4]   2> 438780 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 438780 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-2-001/solr.xml
   [junit4]   2> 438785 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 438787 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37945/solr
   [junit4]   2> 438793 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 438795 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 438796 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45341_xh%2Fp
   [junit4]   2> 438797 INFO  (zkCallback-387-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 438797 INFO  (zkCallback-392-thread-1-processing-n:127.0.0.1:44687_xh%2Fp) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 438797 INFO  (zkCallback-380-thread-1-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 438798 INFO  (zkCallback-398-thread-1-processing-n:127.0.0.1:45341_xh%2Fp) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 438898 INFO  (zkCallback-392-thread-1-processing-n:127.0.0.1:44687_xh%2Fp) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 438911 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 438922 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 438922 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 438923 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-2-001/cores
   [junit4]   2> 438967 INFO  (SocketProxy-Acceptor-45341) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=36766,localport=45341], receiveBufferSize:531000
   [junit4]   2> 438967 INFO  (SocketProxy-Acceptor-45341) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=37767,localport=56812], receiveBufferSize=530904
   [junit4]   2> 438968 INFO  (qtp20678736-2670) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:45341_xh%252Fp&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 438971 INFO  (OverseerCollectionConfigSetProcessor-98527030165831684-127.0.0.1:37257_xh%2Fp-n_0000000000) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 438971 INFO  (OverseerThreadFactory-970-thread-4-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:45341_xh%2Fp for creating new replica
   [junit4]   2> 438972 INFO  (SocketProxy-Acceptor-45341) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=36770,localport=45341], receiveBufferSize:531000
   [junit4]   2> 438973 INFO  (SocketProxy-Acceptor-45341) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=37767,localport=56816], receiveBufferSize=530904
   [junit4]   2> 438973 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 438973 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 439076 INFO  (zkCallback-392-thread-1-processing-n:127.0.0.1:44687_xh%2Fp) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 439076 INFO  (zkCallback-398-thread-1-processing-n:127.0.0.1:45341_xh%2Fp) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 439995 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 440018 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
   [junit4]   2> 440103 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 440115 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
   [junit4]   2> 440115 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 440115 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 440116 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
   [junit4]   2> 440118 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 440120 WARN  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 440160 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 440161 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 440161 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 440161 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 440162 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=1.6982421875, floorSegmentMB=1.0224609375, forceMergeDeletesPctAllowed=24.595564567763446, segmentsPerTier=36.0, maxCFSSegmentSizeMB=0.6201171875, noCFSRatio=0.20630070084716712
   [junit4]   2> 440163 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@162564c[collection1_shard1_replica_t43] main]
   [junit4]   2> 440164 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 440164 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 440164 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 440165 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576432489443885056
   [junit4]   2> 440166 INFO  (searcherExecutor-995-thread-1-processing-n:127.0.0.1:45341_xh%2Fp x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@162564c[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 440169 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 440170 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 440170 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45341/xh/p/collection1_shard1_replica_t43/
   [junit4]   2> 440170 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 440170 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:45341/xh/p/collection1_shard1_replica_t43/ has no replicas
   [junit4]   2> 440170 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 440170 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
   [junit4]   2> 440171 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45341/xh/p/collection1_shard1_replica_t43/ shard1
   [junit4]   2> 440273 INFO  (zkCallback-392-thread-1-processing-n:127.0.0.1:44687_xh%2Fp) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 440273 INFO  (zkCallback-398-thread-1-processing-n:127.0.0.1:45341_xh%2Fp) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 440322 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 440323 INFO  (qtp20678736-2672) [n:127.0.0.1:45341_xh%2Fp c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1350
   [junit4]   2> 440327 INFO  (qtp20678736-2670) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:45341_xh%252Fp&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1358
   [junit4]   2> 440416 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-3-001 of type TLOG
   [junit4]   2> 440416 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 440417 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@fb2107{/xh/p,null,AVAILABLE}
   [junit4]   2> 440417 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@a12fad{HTTP/1.1,[http/1.1]}{127.0.0.1:32865}
   [junit4]   2> 440417 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.e.j.s.Server Started @441354ms
   [junit4]   2> 440418 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/xh/p, hostPort=35321, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-3-001/cores}
   [junit4]   2> 440418 ERROR (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 440418 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 440418 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 440418 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 440418 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T11:59:36.984Z
   [junit4]   2> 440420 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 440420 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-3-001/solr.xml
   [junit4]   2> 440424 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 440426 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:37945/solr
   [junit4]   2> 440426 INFO  (zkCallback-392-thread-1-processing-n:127.0.0.1:44687_xh%2Fp) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 440426 INFO  (zkCallback-398-thread-1-processing-n:127.0.0.1:45341_xh%2Fp) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 440432 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 440432 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 440434 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35321_xh%2Fp
   [junit4]   2> 440434 INFO  (zkCallback-387-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 440434 INFO  (zkCallback-380-thread-2-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 440434 INFO  (zkCallback-398-thread-1-processing-n:127.0.0.1:45341_xh%2Fp) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 440434 INFO  (zkCallback-392-thread-1-processing-n:127.0.0.1:44687_xh%2Fp) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 440435 INFO  (zkCallback-404-thread-1-processing-n:127.0.0.1:35321_xh%2Fp) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 440715 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 440725 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 440725 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 440727 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-3-001/cores
   [junit4]   2> 440783 INFO  (qtp20678736-2671) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:35321_xh%252Fp&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 440784 INFO  (OverseerCollectionConfigSetProcessor-98527030165831684-127.0.0.1:37257_xh%2Fp-n_0000000000) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 440785 INFO  (OverseerThreadFactory-970-thread-5-processing-n:127.0.0.1:37257_xh%2Fp) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:35321_xh%2Fp for creating new replica
   [junit4]   2> 440786 INFO  (SocketProxy-Acceptor-35321) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=50048,localport=35321], receiveBufferSize:531000
   [junit4]   2> 440788 INFO  (SocketProxy-Acceptor-35321) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=32865,localport=52032], receiveBufferSize=530904
   [junit4]   2> 440789 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 440789 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 440893 INFO  (zkCallback-392-thread-1-processing-n:127.0.0.1:44687_xh%2Fp) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 440893 INFO  (zkCallback-398-thread-1-processing-n:127.0.0.1:45341_xh%2Fp) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 440893 INFO  (zkCallback-404-thread-1-processing-n:127.0.0.1:35321_xh%2Fp) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 441827 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 441846 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
   [junit4]   2> 441939 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 441951 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
   [junit4]   2> 441952 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@e269fa
   [junit4]   2> 441952 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 441952 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
   [junit4]   2> 441954 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=48, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
   [junit4]   2> 441963 WARN  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 442002 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 442002 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 442003 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 442003 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 442004 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=34, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=1.6982421875, floorSegmentMB=1.0224609375, forceMergeDeletesPctAllowed=24.595564567763446, segmentsPerTier=36.0, maxCFSSegmentSizeMB=0.6201171875, noCFSRatio=0.20630070084716712
   [junit4]   2> 442004 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@1df750c[collection1_shard2_replica_t45] main]
   [junit4]   2> 442005 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 442005 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 442006 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 442006 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576432491374313472
   [junit4]   2> 442008 INFO  (searcherExecutor-1006-thread-1-processing-n:127.0.0.1:35321_xh%2Fp x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@1df750c[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 442009 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
   [junit4]   2> 442009 INFO  (updateExecutor-401-thread-1-processing-n:127.0.0.1:35321_xh%2Fp x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 442009 INFO  (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:35321_xh%2Fp x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 442009 INFO  (qtp5319492-2705) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1220
   [junit4]   2> 442010 INFO  (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:35321_xh%2Fp x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 442010 INFO  (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:35321_xh%2Fp x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
   [junit4]   2> 442010 INFO  (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:35321_xh%2Fp x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
   [junit4]   2> 442010 INFO  (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:35321_xh%2Fp x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 442010 INFO  (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:35321_xh%2Fp x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:44687/xh/p/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:35321/xh/p/collection1_shard2_replica_t45/]
   [junit4]   2> 442012 INFO  (qtp20678736-2671) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:35321_xh%252Fp&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1229
   [junit4]   2> 442012 INFO  (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:35321_xh%2Fp x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:35321_xh%2Fp c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:44687/xh/p]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:35321_xh%252Fp&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 442012 INFO  (SocketProxy-Acceptor-44687) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=53082,localport=44687], receiveBufferSize:531000
   [junit4]   2> 442013 INFO  (SocketProxy-Acceptor-44687) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35763,localport=40436], receiveBufferSize=530904
   [junit4]   2> 442013 INFO  (qtp13401326-2640) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 442013 INFO  (qtp13401326-2640) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:35321_xh%2Fp, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:35321/xh/p","node_name":"127.0.0.1:35321_xh%2Fp","state":"down","type":"TLOG"}
   [junit4]   2> 442014 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 442014 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Wait for recoveries to finish - wait 30000 for each attempt
   [junit4]   2> 442014 INFO  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30000
   [junit4]   2> 442113 INFO  (zkCallback-398-thread-1-processing-n:127.0.0.1:45341_xh%2Fp) [n:127.0.0.1:45341_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 442113 INFO  (zkCallback-404-thread-1-processing-n:127.0.0.1:35321_xh%2Fp) [n:127.0.0.1:35321_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 442113 INFO  (zkCallback-392-thread-1-processing-n:127.0.0.1:44687_xh%2Fp) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 442785 INFO  (OverseerCollectionConfigSetProcessor-98527030165831684-127.0.0.1:37257_xh%2Fp-n_0000000000) [n:127.0.0.1:37257_xh%2Fp    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 443013 INFO  (qtp13401326-2640) [n:127.0.0.1:44687_xh%2Fp    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false

[...truncated too long message...]

ate/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/collections/collection1/state.json
   [junit4]   2> 	3	/solr/collections/collMinRf_1x3/state.json
   [junit4]   2> 	2	/solr/collections/c8n_crud_1x2/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	4	/solr/overseer/queue
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 468643 WARN  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SocketProxy Closing 8 connections to: http://127.0.0.1:44687/xh/p, target: http://127.0.0.1:35763/xh/p
   [junit4]   2> 468643 WARN  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SocketProxy Closing 9 connections to: http://127.0.0.1:37257/xh/p, target: http://127.0.0.1:37691/xh/p
   [junit4]   2> 468643 WARN  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SocketProxy Closing 6 connections to: http://127.0.0.1:35321/xh/p, target: http://127.0.0.1:32865/xh/p
   [junit4]   2> 468643 WARN  (TEST-HttpPartitionTest.test-seed#[81332594CF3169AA]) [    ] o.a.s.c.SocketProxy Closing 2 connections to: http://127.0.0.1:45341/xh/p, target: http://127.0.0.1:37767/xh/p
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpPartitionTest -Dtests.method=test -Dtests.seed=81332594CF3169AA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de -Dtests.timezone=Asia/Colombo -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 35.0s J2 | HttpPartitionTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:35321/xh/p/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([81332594CF3169AA:9671A4E61CD0452]:0)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_81332594CF3169AA-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {multiDefault=PostingsFormat(name=LuceneVarGapFixedInterval), a_t=PostingsFormat(name=LuceneVarGapFixedInterval), id=Lucene50(blocksize=128), text=PostingsFormat(name=LuceneVarGapDocFreqInterval)}, docValues:{range_facet_l_dv=DocValuesFormat(name=Direct), _version_=DocValuesFormat(name=Memory), range_facet_i_dv=DocValuesFormat(name=Lucene70), intDvoDefault=DocValuesFormat(name=Direct), timestamp=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=254, maxMBSortInHeap=7.202515039122083, sim=RandomSimilarity(queryNorm=true): {}, locale=de, timezone=Asia/Colombo
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=58276208,total=271183872
   [junit4]   2> NOTE: All tests run in this JVM: [TestLeaderElectionZkExpiry, NotRequiredUniqueKeyTest, URLClassifyProcessorTest, BlockJoinFacetSimpleTest, UtilsToolTest, SSLMigrationTest, FullSolrCloudDistribCmdsTest, HdfsChaosMonkeyNothingIsSafeTest, SolrCoreCheckLockOnStartupTest, CdcrVersionReplicationTest, TestLFUCache, TestAuthenticationFramework, TestSchemaSimilarityResource, MigrateRouteKeyTest, TestZkChroot, TestSimpleTextCodec, SolrJmxReporterTest, TestPerFieldSimilarityWithDefaultOverride, ResponseLogComponentTest, TestConfigSetImmutable, TestLegacyTerms, TestRandomFlRTGCloud, CollectionsAPIAsyncDistributedZkTest, RecoveryAfterSoftCommitTest, HttpSolrCallGetCoreTest, TestRestoreCore, TestJsonRequest, SimplePostToolTest, SortByFunctionTest, TestLegacyNumericRangeQueryBuilder, RecoveryZkTest, HttpPartitionTest]
   [junit4] Completed [113/731 (1!)] on J2 in 35.01s, 1 test, 1 failure <<< FAILURES!

[...truncated 1798 lines...]
   [junit4] Suite: org.apache.solr.metrics.reporters.SolrSlf4jReporterTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.metrics.reporters.SolrSlf4jReporterTest_81332594CF3169AA-001/init-core-data-001
   [junit4]   2> 2838239 WARN  (SUITE-SolrSlf4jReporterTest-seed#[81332594CF3169AA]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=44 numCloses=44
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=SolrSlf4jReporterTest -Dtests.method=testReporter -Dtests.seed=81332594CF3169AA -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=de-LU -Dtests.timezone=Etc/Greenwich -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
   [junit4] FAILURE 5.40s J0 | SolrSlf4jReporterTest.testReporter <<<
   [junit4]    > Throwable #1: java.lang.AssertionError
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([81332594CF3169AA:DED708A3A43DFAEF]:0)
   [junit4]    > 	at org.apache.solr.metrics.reporters.SolrSlf4jReporterTest.testReporter(SolrSlf4jReporterTest.java:74)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J0/temp/solr.metrics.reporters.SolrSlf4jReporterTest_81332594CF3169AA-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=318, maxMBSortInHeap=7.300867220801491, sim=RandomSimilarity(queryNorm=false): {}, locale=de-LU, timezone=Etc/Greenwich
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=151688992,total=496271360
   [junit4]   2> NOTE: All tests run in this JVM: [WrapperMergePolicyFactoryTest, TestAuthorizationFramework, LargeFieldTest, TestBadConfig, TestRealTimeGet, TestSolrConfigHandler, TestExpandComponent, TestWordDelimiterFilterFactory, TestReloadAndDeleteDocs, TestDFISimilarityFactory, TestFreeTextSuggestions, DistributedExpandComponentTest, TestDocBasedVersionConstraints, BadCopyFieldTest, TestRangeQuery, TestSolrCoreSnapshots, TestStreamBody, OverseerTaskQueueTest, TestInPlaceUpdatesDistrib, TestFastOutputStream, TestReloadDeadlock, VersionInfoTest, TestMiniSolrCloudClusterSSL, TestFaceting, TestMultiValuedNumericRangeQuery, TestLuceneMatchVersion, ZkFailoverTest, TestMaxScoreQueryParser, TestManagedStopFilterFactory, TestAnalyzeInfixSuggestions, TestCrossCoreJoin, LeaderInitiatedRecoveryOnCommitTest, SolrRequestParserTest, ExitableDirectoryReaderTest, BasicZkTest, TestSha256AuthenticationProvider, DocumentAnalysisRequestHandlerTest, SpellingQueryConverterTest, TestMergePolicyConfig, LeaderElectionContextKeyTest, TestConfigsApi, OutputWriterTest, TestRestManager, EchoParamsTest, RequestHandlersTest, SolrIndexConfigTest, TestHdfsCloudBackupRestore, TestNoOpRegenerator, TestQuerySenderNoQuery, AnalyticsMergeStrategyTest, CurrencyFieldTypeTest, RestartWhileUpdatingTest, PropertiesRequestHandlerTest, ForceLeaderTest, SynonymTokenizerTest, EnumFieldTest, TestSQLHandler, TestPHPSerializedResponseWriter, ZkNodePropsTest, TestExactSharedStatsCache, HdfsUnloadDistributedZkTest, TestRequestForwarding, SolrPluginUtilsTest, TestLazyCores, SolrCloudExampleTest, TestCloudPivotFacet, DistributedFacetPivotLongTailTest, SolrMetricReporterTest, TestDocSet, TestSolr4Spatial, SyncSliceTest, BinaryUpdateRequestHandlerTest, SharedFSAutoReplicaFailoverUtilsTest, SuggesterWFSTTest, ResponseHeaderTest, BlockDirectoryTest, TestManagedSchemaThreadSafety, TestPayloadScoreQParserPlugin, TestComplexPhraseLeadingWildcard, GraphQueryTest, TestLeaderInitiatedRecoveryThread, AssignBackwardCompatibilityTest, TestFieldSortValues, TestPullReplica, TestFunctionQuery, CleanupOldIndexTest, TestBackupRepositoryFactory, AddBlockUpdateTest, SolrGraphiteReporterTest, DeleteReplicaTest, TlogReplayBufferedWhileIndexingTest, CollectionsAPISolrJTest, TestLegacyFieldReuse, XmlUpdateRequestHandlerTest, TestSchemaVersionResource, TestNumericTokenStream, TestGraphMLResponseWriter, TestHashQParserPlugin, BasicAuthIntegrationTest, HdfsLockFactoryTest, StatsReloadRaceTest, CloudMLTQParserTest, V2StandaloneTest, TestDynamicFieldCollectionResource, TestFieldCacheReopen, TestIBSimilarityFactory, HdfsRecoverLeaseTest, BasicDistributedZkTest, TestSolrDeletionPolicy1, TestTrackingShardHandlerFactory, PluginInfoTest, TestCustomDocTransformer, HdfsSyncSliceTest, TestBinaryField, TestRandomRequestDistribution, TestShortCircuitedRequests, TestSolrCloudWithDelegationTokens, TestStressInPlaceUpdates, AutoScalingHandlerTest, HdfsBasicDistributedZk2Test, HdfsChaosMonkeySafeLeaderTest, HdfsNNFailoverTest, HdfsWriteToMultipleCollectionsTest, TestClusterStateMutator, ZkStateReaderTest, TestConfigOverlay, TestConfigSetProperties, TestCustomStream, TestConfigReload, TestSystemCollAutoCreate, DistributedSuggestComponentTest, SuggestComponentTest, SolrSlf4jReporterTest]
   [junit4] Completed [625/731 (2!)] on J0 in 5.45s, 1 test, 1 failure <<< FAILURES!

[...truncated 39689 lines...]

[JENKINS] Lucene-Solr-master-Linux (64bit/jdk1.8.0_144) - Build # 20357 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20357/
Java: 64bit/jdk1.8.0_144 -XX:+UseCompressedOops -XX:+UseSerialGC

1 tests failed.
FAILED:  org.apache.solr.cloud.TestCloudRecovery.leaderRecoverFromLogOnStartupTest

Error Message:


Stack Trace:
java.lang.NullPointerException
	at __randomizedtesting.SeedInfo.seed([1AF35CC142C666D1:6E03BD8406E2215E]:0)
	at org.apache.solr.cloud.TestCloudRecovery.leaderRecoverFromLogOnStartupTest(TestCloudRecovery.java:124)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 12557 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestCloudRecovery
   [junit4]   2> 1663440 INFO  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/init-core-data-001
   [junit4]   2> 1663440 WARN  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=16 numCloses=16
   [junit4]   2> 1663440 INFO  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1663442 INFO  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
   [junit4]   2> 1663442 INFO  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/tempDir-001
   [junit4]   2> 1663442 INFO  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1663444 INFO  (Thread-6381) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1663444 INFO  (Thread-6381) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1663460 ERROR (Thread-6381) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1663543 INFO  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:42529
   [junit4]   2> 1663561 INFO  (jetty-launcher-4768-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1663562 INFO  (jetty-launcher-4768-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 1663581 INFO  (jetty-launcher-4768-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@288da8b2{/solr,null,AVAILABLE}
   [junit4]   2> 1663582 INFO  (jetty-launcher-4768-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@cab3a92{HTTP/1.1,[http/1.1]}{127.0.0.1:34281}
   [junit4]   2> 1663583 INFO  (jetty-launcher-4768-thread-2) [    ] o.e.j.s.Server Started @1664829ms
   [junit4]   2> 1663583 INFO  (jetty-launcher-4768-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=34281}
   [junit4]   2> 1663583 ERROR (jetty-launcher-4768-thread-2) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1663583 INFO  (jetty-launcher-4768-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 1663583 INFO  (jetty-launcher-4768-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1663583 INFO  (jetty-launcher-4768-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1663583 INFO  (jetty-launcher-4768-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T07:18:03.187Z
   [junit4]   2> 1663591 INFO  (jetty-launcher-4768-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@291e9898{/solr,null,AVAILABLE}
   [junit4]   2> 1663591 INFO  (jetty-launcher-4768-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@6eadcaed{HTTP/1.1,[http/1.1]}{127.0.0.1:35503}
   [junit4]   2> 1663591 INFO  (jetty-launcher-4768-thread-1) [    ] o.e.j.s.Server Started @1664838ms
   [junit4]   2> 1663591 INFO  (jetty-launcher-4768-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=35503}
   [junit4]   2> 1663591 ERROR (jetty-launcher-4768-thread-1) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1663591 INFO  (jetty-launcher-4768-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 1663591 INFO  (jetty-launcher-4768-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1663591 INFO  (jetty-launcher-4768-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 1663591 INFO  (jetty-launcher-4768-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T07:18:03.195Z
   [junit4]   2> 1663592 INFO  (jetty-launcher-4768-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1663593 INFO  (jetty-launcher-4768-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1663602 INFO  (jetty-launcher-4768-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42529/solr
   [junit4]   2> 1663602 INFO  (jetty-launcher-4768-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42529/solr
   [junit4]   2> 1663664 INFO  (jetty-launcher-4768-thread-1) [n:127.0.0.1:35503_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1663665 INFO  (jetty-launcher-4768-thread-1) [n:127.0.0.1:35503_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:35503_solr
   [junit4]   2> 1663665 INFO  (jetty-launcher-4768-thread-1) [n:127.0.0.1:35503_solr    ] o.a.s.c.Overseer Overseer (id=98525923446620166-127.0.0.1:35503_solr-n_0000000000) starting
   [junit4]   2> 1663666 INFO  (jetty-launcher-4768-thread-2) [n:127.0.0.1:34281_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1663668 INFO  (jetty-launcher-4768-thread-2) [n:127.0.0.1:34281_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:34281_solr
   [junit4]   2> 1663671 INFO  (zkCallback-4779-thread-1-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1663676 INFO  (zkCallback-4780-thread-1-processing-n:127.0.0.1:35503_solr) [n:127.0.0.1:35503_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1663676 INFO  (jetty-launcher-4768-thread-1) [n:127.0.0.1:35503_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:35503_solr
   [junit4]   2> 1663677 INFO  (zkCallback-4779-thread-1-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1663692 INFO  (zkCallback-4780-thread-1-processing-n:127.0.0.1:35503_solr) [n:127.0.0.1:35503_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1663869 INFO  (jetty-launcher-4768-thread-2) [n:127.0.0.1:34281_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34281.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b98471b
   [junit4]   2> 1663870 INFO  (jetty-launcher-4768-thread-1) [n:127.0.0.1:35503_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35503.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b98471b
   [junit4]   2> 1663876 INFO  (jetty-launcher-4768-thread-2) [n:127.0.0.1:34281_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34281.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b98471b
   [junit4]   2> 1663876 INFO  (jetty-launcher-4768-thread-2) [n:127.0.0.1:34281_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34281.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b98471b
   [junit4]   2> 1663877 INFO  (jetty-launcher-4768-thread-1) [n:127.0.0.1:35503_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35503.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b98471b
   [junit4]   2> 1663877 INFO  (jetty-launcher-4768-thread-1) [n:127.0.0.1:35503_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35503.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b98471b
   [junit4]   2> 1663877 INFO  (jetty-launcher-4768-thread-2) [n:127.0.0.1:34281_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/tempDir-001/node1/.
   [junit4]   2> 1663878 INFO  (jetty-launcher-4768-thread-1) [n:127.0.0.1:35503_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/tempDir-001/node2/.
   [junit4]   2> 1663906 INFO  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1663906 INFO  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42529/solr ready
   [junit4]   2> 1663908 INFO  (qtp830516838-26453) [n:127.0.0.1:34281_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=0&collection.configName=config&maxShardsPerNode=2&name=collection1&nrtReplicas=0&action=CREATE&numShards=2&tlogReplicas=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1663920 INFO  (OverseerThreadFactory-8429-thread-1-processing-n:127.0.0.1:35503_solr) [n:127.0.0.1:35503_solr    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 1664024 INFO  (OverseerStateUpdate-98525923446620166-127.0.0.1:35503_solr-n_0000000000) [n:127.0.0.1:35503_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"collection1_shard1_replica_t1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:35503/solr",
   [junit4]   2>   "type":"TLOG"} 
   [junit4]   2> 1664026 INFO  (OverseerStateUpdate-98525923446620166-127.0.0.1:35503_solr-n_0000000000) [n:127.0.0.1:35503_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"collection1_shard1_replica_t2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34281/solr",
   [junit4]   2>   "type":"TLOG"} 
   [junit4]   2> 1664032 INFO  (OverseerStateUpdate-98525923446620166-127.0.0.1:35503_solr-n_0000000000) [n:127.0.0.1:35503_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"collection1_shard2_replica_t4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:35503/solr",
   [junit4]   2>   "type":"TLOG"} 
   [junit4]   2> 1664035 INFO  (OverseerStateUpdate-98525923446620166-127.0.0.1:35503_solr-n_0000000000) [n:127.0.0.1:35503_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"collection1",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"collection1_shard2_replica_t6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:34281/solr",
   [junit4]   2>   "type":"TLOG"} 
   [junit4]   2> 1664238 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node8&collection.configName=config&newCollection=true&name=collection1_shard2_replica_t6&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 1664238 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1664244 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=collection1_shard1_replica_t1&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 1664244 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1664252 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node5&collection.configName=config&newCollection=true&name=collection1_shard1_replica_t2&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 1664252 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node7&collection.configName=config&newCollection=true&name=collection1_shard2_replica_t4&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 1664363 INFO  (zkCallback-4780-thread-1-processing-n:127.0.0.1:35503_solr) [n:127.0.0.1:35503_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1664363 INFO  (zkCallback-4779-thread-1-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1664368 INFO  (zkCallback-4779-thread-2-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1665625 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1665629 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1665633 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.s.IndexSchema [collection1_shard2_replica_t6] Schema name=minimal
   [junit4]   2> 1665633 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.s.IndexSchema [collection1_shard2_replica_t4] Schema name=minimal
   [junit4]   2> 1665634 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1665635 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1665635 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1665636 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t4' using configuration from collection collection1, trusted=true
   [junit4]   2> 1665636 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t6' using configuration from collection collection1, trusted=true
   [junit4]   2> 1665636 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35503.solr.core.collection1.shard2.replica_t4' (registry 'solr.core.collection1.shard2.replica_t4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b98471b
   [junit4]   2> 1665636 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34281.solr.core.collection1.shard2.replica_t6' (registry 'solr.core.collection1.shard2.replica_t6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b98471b
   [junit4]   2> 1665636 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1665636 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1665636 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.SolrCore [[collection1_shard2_replica_t6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/tempDir-001/node1/collection1_shard2_replica_t6], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/tempDir-001/node1/./collection1_shard2_replica_t6/data/]
   [junit4]   2> 1665636 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.c.SolrCore [[collection1_shard2_replica_t4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/tempDir-001/node2/collection1_shard2_replica_t4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/tempDir-001/node2/./collection1_shard2_replica_t4/data/]
   [junit4]   2> 1665638 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1665643 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.s.IndexSchema [collection1_shard1_replica_t2] Schema name=minimal
   [junit4]   2> 1665644 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1665644 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t2' using configuration from collection collection1, trusted=true
   [junit4]   2> 1665645 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_34281.solr.core.collection1.shard1.replica_t2' (registry 'solr.core.collection1.shard1.replica_t2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b98471b
   [junit4]   2> 1665645 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1665645 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.SolrCore [[collection1_shard1_replica_t2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/tempDir-001/node1/collection1_shard1_replica_t2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/tempDir-001/node1/./collection1_shard1_replica_t2/data/]
   [junit4]   2> 1665645 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.s.IndexSchema [collection1_shard1_replica_t1] Schema name=minimal
   [junit4]   2> 1665647 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 1665647 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t1' using configuration from collection collection1, trusted=true
   [junit4]   2> 1665647 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_35503.solr.core.collection1.shard1.replica_t1' (registry 'solr.core.collection1.shard1.replica_t1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@5b98471b
   [junit4]   2> 1665647 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1665647 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.c.SolrCore [[collection1_shard1_replica_t1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/tempDir-001/node2/collection1_shard1_replica_t1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001/tempDir-001/node2/./collection1_shard1_replica_t1/data/]
   [junit4]   2> 1665690 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1665690 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1665691 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1665691 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1665693 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.s.SolrIndexSearcher Opening [Searcher@610110b2[collection1_shard2_replica_t6] main]
   [junit4]   2> 1665694 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1665695 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1665695 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1665695 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1665695 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1665696 INFO  (searcherExecutor-8435-thread-1-processing-n:127.0.0.1:34281_solr x:collection1_shard2_replica_t6 s:shard2 c:collection1 r:core_node8) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.SolrCore [collection1_shard2_replica_t6] Registered new searcher Searcher@610110b2[collection1_shard2_replica_t6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1665696 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1665696 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576414777494732800
   [junit4]   2> 1665696 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1665698 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.s.SolrIndexSearcher Opening [Searcher@173de6e3[collection1_shard2_replica_t4] main]
   [junit4]   2> 1665699 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1665699 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1665700 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1665700 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576414777498927104
   [junit4]   2> 1665700 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1665702 INFO  (searcherExecutor-8434-thread-1-processing-n:127.0.0.1:35503_solr x:collection1_shard2_replica_t4 s:shard2 c:collection1 r:core_node7) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.c.SolrCore [collection1_shard2_replica_t4] Registered new searcher Searcher@173de6e3[collection1_shard2_replica_t4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1665705 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1665705 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1665706 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1665706 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1665707 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.s.SolrIndexSearcher Opening [Searcher@2f99e5df[collection1_shard1_replica_t2] main]
   [junit4]   2> 1665708 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1665708 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1665708 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1665709 INFO  (searcherExecutor-8436-thread-1-processing-n:127.0.0.1:34281_solr x:collection1_shard1_replica_t2 s:shard1 c:collection1 r:core_node5) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.SolrCore [collection1_shard1_replica_t2] Registered new searcher Searcher@2f99e5df[collection1_shard1_replica_t2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1665709 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576414777508364288
   [junit4]   2> 1665711 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 1665711 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1665711 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1665712 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1665712 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1665714 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.s.SolrIndexSearcher Opening [Searcher@54f39a18[collection1_shard1_replica_t1] main]
   [junit4]   2> 1665715 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
   [junit4]   2> 1665715 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
   [junit4]   2> 1665715 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 1665716 INFO  (searcherExecutor-8437-thread-1-processing-n:127.0.0.1:35503_solr x:collection1_shard1_replica_t1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.c.SolrCore [collection1_shard1_replica_t1] Registered new searcher Searcher@54f39a18[collection1_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1665716 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576414777515704320
   [junit4]   2> 1665812 INFO  (zkCallback-4780-thread-2-processing-n:127.0.0.1:35503_solr) [n:127.0.0.1:35503_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1665812 INFO  (zkCallback-4779-thread-1-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1665812 INFO  (zkCallback-4779-thread-2-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1666201 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1666201 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1666201 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34281/solr/collection1_shard2_replica_t6/
   [junit4]   2> 1666202 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.PeerSync PeerSync: core=collection1_shard2_replica_t6 url=http://127.0.0.1:34281/solr START replicas=[http://127.0.0.1:35503/solr/collection1_shard2_replica_t4/] nUpdates=100
   [junit4]   2> 1666203 INFO  (qtp1211941867-26449) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.c.S.Request [collection1_shard2_replica_t4]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1666212 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1666212 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1666212 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:34281/solr/collection1_shard1_replica_t2/
   [junit4]   2> 1666212 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_t2 url=http://127.0.0.1:34281/solr START replicas=[http://127.0.0.1:35503/solr/collection1_shard1_replica_t1/] nUpdates=100
   [junit4]   2> 1666213 INFO  (qtp1211941867-26462) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.c.S.Request [collection1_shard1_replica_t1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1666502 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.PeerSync PeerSync: core=collection1_shard2_replica_t6 url=http://127.0.0.1:34281/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 1666502 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1666502 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1666502 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1666503 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.ZkController collection1_shard2_replica_t6 stopping background replication from leader
   [junit4]   2> 1666508 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34281/solr/collection1_shard2_replica_t6/ shard2
   [junit4]   2> 1666512 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_t2 url=http://127.0.0.1:34281/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 1666512 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 1666512 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 1666512 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1666513 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.ZkController collection1_shard1_replica_t2 stopping background replication from leader
   [junit4]   2> 1666515 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:34281/solr/collection1_shard1_replica_t2/ shard1
   [junit4]   2> 1666617 INFO  (zkCallback-4780-thread-2-processing-n:127.0.0.1:35503_solr) [n:127.0.0.1:35503_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1666617 INFO  (zkCallback-4779-thread-1-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1666617 INFO  (zkCallback-4779-thread-2-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1666659 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1666660 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node8&collection.configName=config&newCollection=true&name=collection1_shard2_replica_t6&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2422
   [junit4]   2> 1666666 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1666666 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node5&collection.configName=config&newCollection=true&name=collection1_shard1_replica_t2&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2414
   [junit4]   2> 1666702 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.c.ZkController collection1_shard2_replica_t4 starting background replication from leader
   [junit4]   2> 1666702 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 1666704 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 1666704 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Replica core_node8 is leader but it's state is down, skipping replication
   [junit4]   2> 1666705 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node7&collection.configName=config&newCollection=true&name=collection1_shard2_replica_t4&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2452
   [junit4]   2> 1666718 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.c.ZkController collection1_shard1_replica_t1 starting background replication from leader
   [junit4]   2> 1666719 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.c.ReplicateFromLeader Will start replication from leader with poll interval: 00:00:03
   [junit4]   2> 1666719 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.ReplicationHandler Poll scheduled at an interval of 3000ms
   [junit4]   2> 1666719 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Replica core_node5 is leader but it's state is down, skipping replication
   [junit4]   2> 1666720 INFO  (qtp1211941867-26460) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=collection1_shard1_replica_t1&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=2475
   [junit4]   2> 1666721 INFO  (qtp830516838-26453) [n:127.0.0.1:34281_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1666821 INFO  (zkCallback-4780-thread-2-processing-n:127.0.0.1:35503_solr) [n:127.0.0.1:35503_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1666821 INFO  (zkCallback-4779-thread-2-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1666821 INFO  (zkCallback-4779-thread-1-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1667721 INFO  (qtp830516838-26453) [n:127.0.0.1:34281_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=0&collection.configName=config&maxShardsPerNode=2&name=collection1&nrtReplicas=0&action=CREATE&numShards=2&tlogReplicas=2&wt=javabin&version=2} status=0 QTime=3812
   [junit4]   2> 1667721 INFO  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30
   [junit4]   2> 1667721 INFO  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1
   [junit4]   2> 1667731 INFO  (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[1AF35CC142C666D1]) [    ] o.a.s.SolrTestCaseJ4 ###Starting leaderRecoverFromLogOnStartupTest
   [junit4]   2> 1667734 INFO  (qtp1211941867-26522) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&_version_=-1576414779629633536&distrib.from=http://127.0.0.1:34281/solr/collection1_shard1_replica_t2/&wt=javabin&version=2}{deleteByQuery=*:* (-1576414779629633536)} 0 0
   [junit4]   2> 1667734 INFO  (qtp1211941867-26462) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_t4]  webapp=/solr path=/update params={update.distrib=FROMLEADER&_version_=-1576414779630682112&distrib.from=http://127.0.0.1:34281/solr/collection1_shard2_replica_t6/&wt=javabin&version=2}{deleteByQuery=*:* (-1576414779630682112)} 0 0
   [junit4]   2> 1667734 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_t6]  webapp=/solr path=/update params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:34281/solr/collection1_shard1_replica_t2/&wt=javabin&version=2}{deleteByQuery=*:* (-1576414779630682112)} 0 1
   [junit4]   2> 1667734 INFO  (qtp830516838-26454) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t2]  webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1576414779629633536)} 0 2
   [junit4]   2> 1667734 INFO  (qtp1211941867-26447) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.u.TestInjection Start waiting for replica in sync with leader
   [junit4]   2> 1667735 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576414779632779264,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1667734 INFO  (qtp1211941867-26449) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.u.TestInjection Start waiting for replica in sync with leader
   [junit4]   2> 1667735 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1667735 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1667735 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_t2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:34281/solr/collection1_shard1_replica_t2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
   [junit4]   2> 1667736 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576414779633827840,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1667736 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 1667736 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1667736 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_t6]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:34281/solr/collection1_shard1_replica_t2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
   [junit4]   2> 1667736 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1667739 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1667921 INFO  (OverseerCollectionConfigSetProcessor-98525923446620166-127.0.0.1:35503_solr-n_0000000000) [n:127.0.0.1:35503_solr    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 1668238 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1668241 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1668740 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1668743 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1669241 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1669244 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1669704 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Last replication failed, so I'll force replication
   [junit4]   2> 1669704 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Updated masterUrl to http://127.0.0.1:34281/solr/collection1_shard2_replica_t6/
   [junit4]   2> 1669705 INFO  (qtp830516838-26452) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1669705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1669705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1669705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 1669705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 1669705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 1669705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1669705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@4015fd6 commitCommandVersion:0
   [junit4]   2> 1669715 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.s.SolrIndexSearcher Opening [Searcher@453c55ed[collection1_shard2_replica_t4] main]
   [junit4]   2> 1669715 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1669716 INFO  (searcherExecutor-8434-thread-1-processing-n:127.0.0.1:35503_solr x:collection1_shard2_replica_t4 s:shard2 c:collection1 r:core_node7) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.c.SolrCore [collection1_shard2_replica_t4] Registered new searcher Searcher@453c55ed[collection1_shard2_replica_t4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1669719 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Last replication failed, so I'll force replication
   [junit4]   2> 1669719 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Updated masterUrl to http://127.0.0.1:34281/solr/collection1_shard1_replica_t2/
   [junit4]   2> 1669720 INFO  (qtp830516838-26453) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1669720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1669720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1669720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 1669720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 1669720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher New index in Master. Deleting mine...
   [junit4]   2> 1669720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.u.DirectUpdateHandler2 start commit{,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 1669720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@9c9a923 commitCommandVersion:0
   [junit4]   2> 1669730 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.s.SolrIndexSearcher Opening [Searcher@331c253[collection1_shard1_replica_t1] main]
   [junit4]   2> 1669730 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 1669731 INFO  (searcherExecutor-8437-thread-1-processing-n:127.0.0.1:35503_solr x:collection1_shard1_replica_t1 s:shard1 c:collection1 r:core_node3) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.c.SolrCore [collection1_shard1_replica_t1] Registered new searcher Searcher@331c253[collection1_shard1_replica_t1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1669743 INFO  (qtp830516838-26453) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1669746 INFO  (qtp830516838-26453) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1670244 INFO  (qtp830516838-26453) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1670247 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1670746 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1670748 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1671248 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1671250 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1671749 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1671751 INFO  (qtp830516838-26452) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1672251 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1672253 INFO  (qtp830516838-26452) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1672704 INFO  (qtp830516838-26452) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1672705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1672705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1672705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1672705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Slave's version: 1503386289309
   [junit4]   2> 1672719 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1672720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1672720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1672720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1672720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Slave's version: 1503386289324
   [junit4]   2> 1672753 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1672755 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1673254 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1673256 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1673756 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1673758 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1674258 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1674259 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1674760 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1674761 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1675262 INFO  (qtp830516838-26452) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1675263 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1675704 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1675704 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1675705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1675705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1675705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Slave's version: 1503386289309
   [junit4]   2> 1675720 INFO  (qtp830516838-26452) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1675720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1675720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1675720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1675720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Slave's version: 1503386289324
   [junit4]   2> 1675764 INFO  (qtp830516838-26450) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1675764 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1676265 INFO  (qtp830516838-26452) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1676265 INFO  (qtp830516838-26453) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1676767 INFO  (qtp830516838-26446) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1676767 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1677268 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1677268 INFO  (qtp830516838-26454) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1677769 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1677769 INFO  (qtp830516838-26453) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1678271 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1678271 INFO  (qtp830516838-26453) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1678704 INFO  (qtp830516838-26452) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1678705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1678705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1678705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1678705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Slave's version: 1503386289309
   [junit4]   2> 1678720 INFO  (qtp830516838-26454) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1678720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1678720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1678720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1678720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Slave's version: 1503386289324
   [junit4]   2> 1678773 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1678773 INFO  (qtp830516838-26446) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1679274 INFO  (qtp830516838-26446) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1679274 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1679776 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1679776 INFO  (qtp830516838-26454) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1680278 INFO  (qtp830516838-26446) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1680278 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1680779 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1680779 INFO  (qtp830516838-26454) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1681281 INFO  (qtp830516838-26455) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1681281 INFO  (qtp830516838-26446) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=details} status=0 QTime=0
   [junit4]   2> 1681704 INFO  (qtp830516838-26452) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1681705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1681705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1681705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1681705 INFO  (indexFetcher-8455-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard2 r:core_node7 x:collection1_shard2_replica_t4] o.a.s.h.IndexFetcher Slave's version: 1503386289309
   [junit4]   2> 1681720 INFO  (qtp830516838-26453) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.S.Request [collection1_shard1_replica_t2]  webapp=/solr path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 1681720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 1681720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 1681720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Slave's generation: 2
   [junit4]   2> 1681720 INFO  (indexFetcher-8457-thread-1) [n:127.0.0.1:35503_solr c:collection1 s:shard1 r:core_node3 x:collection1_shard1_replica_t1] o.a.s.h.IndexFetcher Slave's version: 1503386289324
   [junit4]   2> 1681783 INFO  (qtp830516838-26445) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.S.Request [collection1_shard2_replica_t6]  webapp=/solr path=/replication params={qt=/replication&wt=jav

[...truncated too long message...]

 o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=213285045
   [junit4]   2> 1750032 INFO  (zkCallback-4805-thread-2-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1750122 INFO  (zkCallback-4805-thread-2-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1750122 INFO  (zkCallback-4805-thread-3-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 1751532 WARN  (zkCallback-4811-thread-1-processing-n:127.0.0.1:35503_solr) [n:127.0.0.1:35503_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1751533 INFO  (jetty-closer-4769-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@a95f31f{/solr,null,UNAVAILABLE}
   [junit4]   2> 1754227 ERROR (recoveryExecutor-4803-thread-2-processing-n:127.0.0.1:34281_solr x:collection1_shard2_replica_t6 s:shard2 c:collection1 r:core_node8) [n:127.0.0.1:34281_solr c:collection1 s:shard2 r:core_node8 x:collection1_shard2_replica_t6] o.a.s.c.RecoveryStrategy SolrCore not found - cannot recover:collection1_shard2_replica_t6
   [junit4]   2> 1754228 ERROR (recoveryExecutor-4803-thread-2-processing-n:127.0.0.1:34281_solr x:collection1_shard1_replica_t2 s:shard1 c:collection1 r:core_node5) [n:127.0.0.1:34281_solr c:collection1 s:shard1 r:core_node5 x:collection1_shard1_replica_t2] o.a.s.c.RecoveryStrategy SolrCore not found - cannot recover:collection1_shard1_replica_t2
   [junit4]   2> 1754228 INFO  (jetty-closer-4769-thread-1) [    ] o.a.s.c.Overseer Overseer (id=98525923446620177-127.0.0.1:34281_solr-n_0000000004) closing
   [junit4]   2> 1754228 INFO  (OverseerStateUpdate-98525923446620177-127.0.0.1:34281_solr-n_0000000004) [n:127.0.0.1:34281_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:34281_solr
   [junit4]   2> 1754229 WARN  (zkCallback-4805-thread-3-processing-n:127.0.0.1:34281_solr) [n:127.0.0.1:34281_solr    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 1754229 INFO  (jetty-closer-4769-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@77c80d88{/solr,null,UNAVAILABLE}
   [junit4]   2> 1754229 ERROR (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1754229 INFO  (SUITE-TestCloudRecovery-seed#[1AF35CC142C666D1]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42529 42529
   [junit4]   2> 1755019 INFO  (Thread-6381) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42529 42529
   [junit4]   2> 1755019 WARN  (Thread-6381) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/aliases.json
   [junit4]   2> 	7	/solr/clusterprops.json
   [junit4]   2> 	6	/solr/security.json
   [junit4]   2> 	6	/solr/configs/config
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	61	/solr/collections/collection1/state.json
   [junit4]   2> 	7	/solr/clusterstate.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	7	/solr/collections
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 	3	/solr/overseer/queue
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.TestCloudRecovery_1AF35CC142C666D1-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {id=FSTOrd50}, docValues:{_version_=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=648, maxMBSortInHeap=6.83737618304108, sim=RandomSimilarity(queryNorm=true): {}, locale=it-IT, timezone=America/Bogota
   [junit4]   2> NOTE: Linux 4.10.0-27-generic amd64/Oracle Corporation 1.8.0_144 (64-bit)/cpus=8,threads=1,free=260784760,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [CopyFieldTest, LeaderFailureAfterFreshStartTest, DocValuesMissingTest, PKIAuthenticationIntegrationTest, DistributedDebugComponentTest, TestGroupingSearch, ConfigSetsAPITest, TestRuleBasedAuthorizationPlugin, MigrateRouteKeyTest, TestSurroundQueryParser, PrimitiveFieldTypeTest, TestRecoveryHdfs, SpellCheckCollatorWithCollapseTest, CoreAdminRequestStatusTest, TestCopyFieldCollectionResource, SparseHLLTest, TestSolrConfigHandlerCloud, PreAnalyzedUpdateProcessorTest, TestNamedUpdateProcessors, DocExpirationUpdateProcessorFactoryTest, TestLeaderElectionZkExpiry, UtilsToolTest, TestReversedWildcardFilterFactory, NodeMutatorTest, TestFoldingMultitermQuery, BigEndianAscendingWordSerializerTest, TestRTimerTree, TestLegacyField, VMParamsZkACLAndCredentialsProvidersTest, SignatureUpdateProcessorFactoryTest, TestPrepRecovery, TestDistribIDF, TestSSLRandomization, HdfsDirectoryTest, TestXmlQParserPlugin, TestRandomCollapseQParserPlugin, TestJmxIntegration, UninvertDocValuesMergePolicyTest, OverseerTest, DateFieldTest, TestSuggestSpellingConverter, TestManagedSchemaAPI, QueryEqualityTest, TestManagedSynonymGraphFilterFactory, StatsComponentTest, TestCustomSort, TestPerFieldSimilarityWithDefaultOverride, TestStressUserVersions, TermVectorComponentDistributedTest, BlockJoinFacetSimpleTest, SolrShardReporterTest, OverseerCollectionConfigSetProcessorTest, TestCloudJSONFacetJoinDomain, ChangedSchemaMergeTest, TestLMJelinekMercerSimilarityFactory, HdfsTlogReplayBufferedWhileIndexingTest, TestCodecSupport, TestNestedDocsSort, SuggesterFSTTest, TestSchemaSimilarityResource, TestPushWriter, HdfsRestartWhileUpdatingTest, V2ApiIntegrationTest, SolrJmxReporterTest, TestAnalyzedSuggestions, InfixSuggestersTest, TestTolerantUpdateProcessorRandomCloud, TestAuthenticationFramework, RulesTest, TestBinaryResponseWriter, TestLegacyTerms, StressHdfsTest, TestPivotHelperCode, TestFieldCache, ZkStateWriterTest, MoveReplicaHDFSUlogDirTest, TestConfigSetsAPIExclusivity, HighlighterMaxOffsetTest, CdcrReplicationDistributedZkTest, RecoveryAfterSoftCommitTest, DirectUpdateHandlerOptimizeTest, UpdateLogTest, TestStressReorder, PathHierarchyTokenizerFactoryTest, DistributedFacetPivotSmallTest, TestStressLiveNodes, DeleteNodeTest, TestQuerySenderListener, RecoveryZkTest, FullHLLTest, TestMinMaxOnMultiValuedField, TestCollectionAPI, AliasIntegrationTest, TestHdfsBackupRestoreCore, TestFastWriter, TimeZoneUtilsTest, JvmMetricsTest, ResponseLogComponentTest, CdcrUpdateLogTest, UniqFieldsUpdateProcessorFactoryTest, CustomCollectionTest, TestReload, TestTolerantSearch, TestSort, MetricsHandlerTest, TestFieldCollectionResource, OverseerStatusTest, SolrIndexMetricsTest, CursorMarkTest, TestSimpleTextCodec, SpellPossibilityIteratorTest, TestBulkSchemaConcurrent, TestPayloadCheckQParserPlugin, PreAnalyzedFieldManagedSchemaCloudTest, TestDistributedStatsComponentCardinality, SolrCLIZkUtilsTest, DistribJoinFromCollectionTest, TestUniqueKeyFieldResource, TestSubQueryTransformerCrossCore, UnloadDistributedZkTest, OpenCloseCoreStressTest, ShardRoutingTest, BasicZkTest, TestReplicationHandler, TestZkChroot, ShardRoutingCustomTest, AutoCommitTest, TestFaceting, TestRecovery, HardAutoCommitTest, TestCoreContainer, SimpleFacetsTest, SolrCoreTest, BasicFunctionalityTest, TestLazyCores, DirectUpdateHandlerTest, TestBadConfig, TestIndexSearcher, HighlighterTest, ShowFileRequestHandlerTest, SimplePostToolTest, TestCoreDiscovery, AnalysisAfterCoreReloadTest, DocValuesTest, SuggesterTest, TestStressLucene, TestTrie, SuggesterWFSTTest, TestCSVLoader, PolyFieldTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, DefaultValueUpdateProcessorTest, StatelessScriptUpdateProcessorFactoryTest, SortByFunctionTest, DocValuesMultiTest, DistanceFunctionTest, SolrInfoBeanTest, XsltUpdateRequestHandlerTest, CacheHeaderTest, IndexBasedSpellCheckerTest, TestQueryUtils, TestWriterPerf, DirectSolrSpellCheckerTest, DocumentAnalysisRequestHandlerTest, TestOmitPositions, TermsComponentTest, RequestHandlersTest, DocumentBuilderTest, TermVectorComponentTest, MoreLikeThisHandlerTest, RequiredFieldsTest, TestSolrQueryParser, FastVectorHighlighterTest, RegexBoostProcessorTest, SolrPluginUtilsTest, TestCollationField, ReturnFieldsTest, TestCSVResponseWriter, MBeansHandlerTest, QueryParsingTest, JsonLoaderTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, PingRequestHandlerTest, SOLR749Test, UpdateParamsTest, AlternateDirectoryTest, TestStressRecovery, PreAnalyzedFieldTest, TestSystemIdResolver, DOMUtilTest, ClusterStateTest, TestLRUCache, TestUtils, TestDocumentBuilder, FileUtilsTest, CircularListTest, TestRTGBase, CursorPagingTest, DistributedIntervalFacetingTest, TestHighlightDedupGrouping, AsyncCallRequestStatusResponseTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, DeleteShardTest, DocValuesNotIndexedTest, HealthCheckHandlerTest, HttpPartitionTest, TestCloudDeleteByQuery, TestCloudRecovery]
   [junit4] Completed [538/731 (1!)] on J2 in 91.62s, 2 tests, 1 error <<< FAILURES!

[...truncated 43886 lines...]

[JENKINS-EA] Lucene-Solr-master-Linux (32bit/jdk-9-ea+181) - Build # 20356 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20356/
Java: 32bit/jdk-9-ea+181 -client -XX:+UseParallelGC --illegal-access=deny

1 tests failed.
FAILED:  org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete

Error Message:
Error from server at http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html> <head> <meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/> <title>Error 404 </title> </head> <body> <h2>HTTP ERROR: 404</h2> <p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason: <pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p> <hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/> </body> </html> 

Stack Trace:
org.apache.solr.client.solrj.impl.CloudSolrClient$RouteException: Error from server at http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at __randomizedtesting.SeedInfo.seed([4DA56F9A8281768B:EE5FC13F05699C2E]:0)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.directUpdate(CloudSolrClient.java:539)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:993)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
	at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
	at org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete(TestCollectionsAPIViaSolrCloudCluster.java:167)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.base/java.lang.reflect.Method.invoke(Method.java:564)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.base/java.lang.Thread.run(Thread.java:844)
Caused by: org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2: Expected mime type application/octet-stream but got text/html. <html>
<head>
<meta http-equiv="Content-Type" content="text/html;charset=ISO-8859-1"/>
<title>Error 404 </title>
</head>
<body>
<h2>HTTP ERROR: 404</h2>
<p>Problem accessing /solr/testcollection_shard1_replica_n2/update. Reason:
<pre>    Can not find: /solr/testcollection_shard1_replica_n2/update</pre></p>
<hr /><a href="http://eclipse.org/jetty">Powered by Jetty:// 9.3.20.v20170531</a><hr/>
</body>
</html>

	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:591)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:253)
	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:242)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
	at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
	at org.apache.solr.client.solrj.impl.CloudSolrClient.lambda$directUpdate$0(CloudSolrClient.java:516)
	at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264)
	at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
	at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1167)
	at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
	... 1 more




Build Log:
[...truncated 12576 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestCollectionsAPIViaSolrCloudCluster
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/init-core-data-001
   [junit4]   2> 2149697 WARN  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[4DA56F9A8281768B]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=9 numCloses=9
   [junit4]   2> 2149697 INFO  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[4DA56F9A8281768B]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2149698 INFO  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[4DA56F9A8281768B]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
   [junit4]   2> 2149698 INFO  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[4DA56F9A8281768B]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2149699 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 5 servers in /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001
   [junit4]   2> 2149699 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 2149700 INFO  (Thread-5708) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 2149700 INFO  (Thread-5708) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 2149701 ERROR (Thread-5708) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2149800 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.ZkTestServer start zk server on port:43029
   [junit4]   2> 2149803 INFO  (jetty-launcher-2757-thread-4) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2149803 INFO  (jetty-launcher-2757-thread-5) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2149803 INFO  (jetty-launcher-2757-thread-1) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2149803 INFO  (jetty-launcher-2757-thread-2) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2149804 INFO  (jetty-launcher-2757-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@33f6ab{/solr,null,AVAILABLE}
   [junit4]   2> 2149804 INFO  (jetty-launcher-2757-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1d3675{/solr,null,AVAILABLE}
   [junit4]   2> 2149804 INFO  (jetty-launcher-2757-thread-4) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1848360{/solr,null,AVAILABLE}
   [junit4]   2> 2149805 INFO  (jetty-launcher-2757-thread-5) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17596b6{/solr,null,AVAILABLE}
   [junit4]   2> 2149803 INFO  (jetty-launcher-2757-thread-3) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2149806 INFO  (jetty-launcher-2757-thread-4) [    ] o.e.j.s.AbstractConnector Started ServerConnector@941bec{HTTP/1.1,[http/1.1]}{127.0.0.1:36073}
   [junit4]   2> 2149806 INFO  (jetty-launcher-2757-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@70afa5{HTTP/1.1,[http/1.1]}{127.0.0.1:36639}
   [junit4]   2> 2149810 INFO  (jetty-launcher-2757-thread-4) [    ] o.e.j.s.Server Started @2151126ms
   [junit4]   2> 2149810 INFO  (jetty-launcher-2757-thread-1) [    ] o.e.j.s.Server Started @2151126ms
   [junit4]   2> 2149810 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36073}
   [junit4]   2> 2149810 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=36639}
   [junit4]   2> 2149810 ERROR (jetty-launcher-2757-thread-1) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2149810 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2149810 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2149810 INFO  (jetty-launcher-2757-thread-3) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1a2ca4d{/solr,null,AVAILABLE}
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T01:24:57.249076Z
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-3) [    ] o.e.j.s.AbstractConnector Started ServerConnector@10d67eb{HTTP/1.1,[http/1.1]}{127.0.0.1:45345}
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-3) [    ] o.e.j.s.Server Started @2151127ms
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45345}
   [junit4]   2> 2149806 INFO  (jetty-launcher-2757-thread-5) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1bbd126{HTTP/1.1,[http/1.1]}{127.0.0.1:33065}
   [junit4]   2> 2149806 INFO  (jetty-launcher-2757-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@1584acb{HTTP/1.1,[http/1.1]}{127.0.0.1:43591}
   [junit4]   2> 2149811 ERROR (jetty-launcher-2757-thread-3) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-2) [    ] o.e.j.s.Server Started @2151127ms
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=43591}
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-5) [    ] o.e.j.s.Server Started @2151127ms
   [junit4]   2> 2149810 ERROR (jetty-launcher-2757-thread-4) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2149811 ERROR (jetty-launcher-2757-thread-2) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=33065}
   [junit4]   2> 2149811 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2149812 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2149812 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T01:24:57.250204Z
   [junit4]   2> 2149812 ERROR (jetty-launcher-2757-thread-5) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2149812 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T01:24:57.250064Z
   [junit4]   2> 2149812 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2149812 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T01:24:57.249997Z
   [junit4]   2> 2149812 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2149812 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2149812 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T01:24:57.250579Z
   [junit4]   2> 2149813 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2149813 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2149813 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2149813 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2149826 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43029/solr
   [junit4]   2> 2149827 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43029/solr
   [junit4]   2> 2149827 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43029/solr
   [junit4]   2> 2149827 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43029/solr
   [junit4]   2> 2149828 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43029/solr
   [junit4]   2> 2149828 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn caught end of stream exception
   [junit4]   2> EndOfStreamException: Unable to read additional data from client sessionid 0x15e078ae6b20007, likely client has closed socket
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
   [junit4]   2> 	at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
   [junit4]   2> 	at java.base/java.lang.Thread.run(Thread.java:844)
   [junit4]   2> 2149843 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2149843 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2149843 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45345_solr
   [junit4]   2> 2149844 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36073_solr
   [junit4]   2> 2149844 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.c.Overseer Overseer (id=98524535006035983-127.0.0.1:45345_solr-n_0000000000) starting
   [junit4]   2> 2149845 INFO  (zkCallback-2783-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2149846 INFO  (zkCallback-2784-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 2149863 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45345_solr
   [junit4]   2> 2149865 INFO  (zkCallback-2783-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2149870 INFO  (zkCallback-2784-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 2149885 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 2149886 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2149887 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36639_solr
   [junit4]   2> 2149888 INFO  (zkCallback-2783-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2149889 INFO  (zkCallback-2782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2149889 INFO  (zkCallback-2784-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 2149893 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 2149899 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2149900 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:43591_solr
   [junit4]   2> 2149901 INFO  (zkCallback-2782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2149901 INFO  (zkCallback-2783-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2149905 INFO  (zkCallback-2780-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2149912 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36073.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2149921 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36073.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2149921 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36073.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2149922 INFO  (jetty-launcher-2757-thread-4) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node4/.
   [junit4]   2> 2149926 INFO  (zkCallback-2784-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 2149936 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2149937 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2149938 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33065_solr
   [junit4]   2> 2149939 INFO  (zkCallback-2782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2149939 INFO  (zkCallback-2781-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2149939 INFO  (zkCallback-2783-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2149943 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45345.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2149946 INFO  (zkCallback-2780-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2149946 INFO  (zkCallback-2784-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2149951 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45345.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2149951 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45345.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2149953 INFO  (jetty-launcher-2757-thread-3) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node3/.
   [junit4]   2> 2150004 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43591.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2150011 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43591.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2150011 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43591.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2150012 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36639.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2150012 INFO  (jetty-launcher-2757-thread-2) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node2/.
   [junit4]   2> 2150021 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36639.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2150021 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_36639.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2150023 INFO  (jetty-launcher-2757-thread-1) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node1/.
   [junit4]   2> 2150036 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33065.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2150044 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33065.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2150044 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33065.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2150045 INFO  (jetty-launcher-2757-thread-5) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node5/.
   [junit4]   2> 2150098 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (5)
   [junit4]   2> 2150098 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43029/solr ready
   [junit4]   2> 2150100 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testCollectionCreateSearchDelete
   [junit4]   2> 2150100 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@941bec{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2150100 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=21731823
   [junit4]   2> 2150100 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2150100 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@55af0c: rootName = solr_36073, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@992a9b
   [junit4]   2> 2150106 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2150106 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@14f0227: rootName = solr_36073, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@15449bb
   [junit4]   2> 2150110 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2150110 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@45c46: rootName = solr_36073, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@397004
   [junit4]   2> 2150110 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 2150110 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2150111 INFO  (zkCallback-2782-thread-2) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
   [junit4]   2> 2150111 INFO  (zkCallback-2793-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
   [junit4]   2> 2150111 INFO  (zkCallback-2781-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
   [junit4]   2> 2150111 INFO  (zkCallback-2780-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
   [junit4]   2> 2150111 INFO  (zkCallback-2783-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (5) -> (4)
   [junit4]   2> 2151611 WARN  (zkCallback-2784-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2151611 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1848360{/solr,null,UNAVAILABLE}
   [junit4]   2> 2151612 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 2151613 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1443f9f{/solr,null,AVAILABLE}
   [junit4]   2> 2151613 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@13e44ce{HTTP/1.1,[http/1.1]}{127.0.0.1:38783}
   [junit4]   2> 2151613 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.e.j.s.Server Started @2152929ms
   [junit4]   2> 2151613 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38783}
   [junit4]   2> 2151613 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2151613 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 2151613 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 2151613 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 2151613 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-22T01:24:59.051821Z
   [junit4]   2> 2151615 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 2151620 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43029/solr
   [junit4]   2> 2151625 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
   [junit4]   2> 2151626 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 2151626 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38783_solr
   [junit4]   2> 2151627 INFO  (zkCallback-2781-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2151627 INFO  (zkCallback-2793-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2151627 INFO  (zkCallback-2782-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2151627 INFO  (zkCallback-2780-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2151627 INFO  (zkCallback-2783-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2151628 INFO  (zkCallback-2798-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
   [junit4]   2> 2151678 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38783.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2151686 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38783.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2151686 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38783.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2151687 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node6/.
   [junit4]   2> 2151726 INFO  (qtp28420368-19944) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params async=cf898f05-846c-48e9-9572-c3573de50a2e&replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=1&name=testcollection&nrtReplicas=2&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2151727 INFO  (qtp28420368-19944) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=cf898f05-846c-48e9-9572-c3573de50a2e&replicationFactor=2&collection.configName=solrCloudCollectionConfig&maxShardsPerNode=1&name=testcollection&nrtReplicas=2&action=CREATE&numShards=2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2151727 INFO  (qtp28420368-19948) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2151727 INFO  (qtp28420368-19948) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2151728 INFO  (OverseerThreadFactory-8307-thread-1) [    ] o.a.s.c.CreateCollectionCmd Create collection testcollection
   [junit4]   2> 2151830 INFO  (OverseerStateUpdate-98524535006035983-127.0.0.1:45345_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testcollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testcollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:33065/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2151831 INFO  (OverseerStateUpdate-98524535006035983-127.0.0.1:45345_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testcollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"testcollection_shard1_replica_n2",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:38783/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2151832 INFO  (OverseerStateUpdate-98524535006035983-127.0.0.1:45345_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testcollection",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testcollection_shard2_replica_n4",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45345/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2151833 INFO  (OverseerStateUpdate-98524535006035983-127.0.0.1:45345_solr-n_0000000000) [    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"testcollection",
   [junit4]   2>   "shard":"shard2",
   [junit4]   2>   "core":"testcollection_shard2_replica_n6",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:43591/solr",
   [junit4]   2>   "type":"NRT"} 
   [junit4]   2> 2152035 INFO  (qtp10467983-19947) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=cf898f05-846c-48e9-9572-c3573de50a2e2362022272209619&coreNodeName=core_node3&name=testcollection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=0
   [junit4]   2> 2152035 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=cf898f05-846c-48e9-9572-c3573de50a2e2362022272209619&coreNodeName=core_node3&name=testcollection_shard1_replica_n1&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 2152035 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=cf898f05-846c-48e9-9572-c3573de50a2e2362022273562631&coreNodeName=core_node7&name=testcollection_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 2152035 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=cf898f05-846c-48e9-9572-c3573de50a2e2362022274332183&coreNodeName=core_node8&name=testcollection_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 2152035 INFO  (qtp28420368-19927) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=cf898f05-846c-48e9-9572-c3573de50a2e2362022274332183&coreNodeName=core_node8&name=testcollection_shard2_replica_n6&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=0
   [junit4]   2> 2152035 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=cf898f05-846c-48e9-9572-c3573de50a2e2362022272888009&coreNodeName=core_node5&name=testcollection_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin
   [junit4]   2> 2152035 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2152035 INFO  (qtp29099948-19962) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=cf898f05-846c-48e9-9572-c3573de50a2e2362022273562631&coreNodeName=core_node7&name=testcollection_shard2_replica_n4&action=CREATE&numShards=2&shard=shard2&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=0
   [junit4]   2> 2152035 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2152035 INFO  (qtp19355274-20049) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=solrCloudCollectionConfig&newCollection=true&collection=testcollection&version=2&replicaType=NRT&async=cf898f05-846c-48e9-9572-c3573de50a2e2362022272888009&coreNodeName=core_node5&name=testcollection_shard1_replica_n2&action=CREATE&numShards=2&shard=shard1&property.solr.directoryFactory=solr.StandardDirectoryFactory&wt=javabin} status=0 QTime=0
   [junit4]   2> 2152035 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2152035 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2152036 INFO  (qtp28420368-19944) [    ] o.a.s.h.a.CoreAdminOperation Checking request status for : cf898f05-846c-48e9-9572-c3573de50a2e2362022274332183
   [junit4]   2> 2152036 INFO  (qtp28420368-19944) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=cf898f05-846c-48e9-9572-c3573de50a2e2362022274332183&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2152139 INFO  (zkCallback-2780-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2152139 INFO  (zkCallback-2783-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2152139 INFO  (zkCallback-2783-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2152139 INFO  (zkCallback-2781-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2152139 INFO  (zkCallback-2798-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2152139 INFO  (zkCallback-2781-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2152139 INFO  (zkCallback-2798-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2152140 INFO  (zkCallback-2780-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2152728 INFO  (qtp10467983-19955) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2152729 INFO  (qtp10467983-19955) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2153036 INFO  (qtp28420368-19948) [    ] o.a.s.h.a.CoreAdminOperation Checking request status for : cf898f05-846c-48e9-9572-c3573de50a2e2362022274332183
   [junit4]   2> 2153036 INFO  (qtp28420368-19948) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=cf898f05-846c-48e9-9572-c3573de50a2e2362022274332183&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2153040 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2153050 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2153051 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2153054 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.s.IndexSchema [testcollection_shard2_replica_n6] Schema name=minimal
   [junit4]   2> 2153054 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.s.IndexSchema [testcollection_shard1_replica_n1] Schema name=minimal
   [junit4]   2> 2153054 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.s.IndexSchema [testcollection_shard2_replica_n4] Schema name=minimal
   [junit4]   2> 2153055 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2153055 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2153055 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2153055 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard1_replica_n1' using configuration from collection testcollection, trusted=true
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard2_replica_n6' using configuration from collection testcollection, trusted=true
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard2_replica_n4' using configuration from collection testcollection, trusted=true
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_43591.solr.core.testcollection.shard2.replica_n6' (registry 'solr.core.testcollection.shard2.replica_n6') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_33065.solr.core.testcollection.shard1.replica_n1' (registry 'solr.core.testcollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45345.solr.core.testcollection.shard2.replica_n4' (registry 'solr.core.testcollection.shard2.replica_n4') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.c.SolrCore [[testcollection_shard2_replica_n6] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node2/testcollection_shard2_replica_n6], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node2/./testcollection_shard2_replica_n6/data/]
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.SolrCore [[testcollection_shard2_replica_n4] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node3/testcollection_shard2_replica_n4], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node3/./testcollection_shard2_replica_n4/data/]
   [junit4]   2> 2153056 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.c.SolrCore [[testcollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node5/testcollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node5/./testcollection_shard1_replica_n1/data/]
   [junit4]   2> 2153059 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.s.IndexSchema [testcollection_shard1_replica_n2] Schema name=minimal
   [junit4]   2> 2153060 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
   [junit4]   2> 2153060 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.CoreContainer Creating SolrCore 'testcollection_shard1_replica_n2' using configuration from collection testcollection, trusted=true
   [junit4]   2> 2153060 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38783.solr.core.testcollection.shard1.replica_n2' (registry 'solr.core.testcollection.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@109c60f
   [junit4]   2> 2153060 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2153061 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.SolrCore [[testcollection_shard1_replica_n2] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node6/testcollection_shard1_replica_n2], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001/tempDir-001/node6/./testcollection_shard1_replica_n2/data/]
   [junit4]   2> 2153112 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2153112 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2153113 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2153113 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2153114 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@1c5821a[testcollection_shard1_replica_n2] main]
   [junit4]   2> 2153115 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 2153115 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 2153116 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 2153116 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576392563678511104
   [junit4]   2> 2153118 INFO  (searcherExecutor-8328-thread-1) [    ] o.a.s.c.SolrCore [testcollection_shard1_replica_n2] Registered new searcher Searcher@1c5821a[testcollection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2153120 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 2153122 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2153122 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2153123 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2153123 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2153125 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@10ea2e8[testcollection_shard2_replica_n4] main]
   [junit4]   2> 2153125 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 2153126 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 2153126 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 2153130 INFO  (searcherExecutor-8327-thread-1) [    ] o.a.s.c.SolrCore [testcollection_shard2_replica_n4] Registered new searcher Searcher@10ea2e8[testcollection_shard2_replica_n4] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2153130 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576392563693191168
   [junit4]   2> 2153132 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2153133 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
   [junit4]   2> 2153133 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2153133 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2153133 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2153134 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@85e304[testcollection_shard2_replica_n6] main]
   [junit4]   2> 2153135 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 2153135 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 2153135 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 2153136 INFO  (searcherExecutor-8326-thread-1) [    ] o.a.s.c.SolrCore [testcollection_shard2_replica_n6] Registered new searcher Searcher@85e304[testcollection_shard2_replica_n6] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2153136 INFO  (parallelCoreAdminExecutor-8312-thread-1) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576392563699482624
   [junit4]   2> 2153138 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2153138 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2153139 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2153139 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2153141 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@cf4c89[testcollection_shard1_replica_n1] main]
   [junit4]   2> 2153141 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/solrCloudCollectionConfig
   [junit4]   2> 2153141 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/solrCloudCollectionConfig
   [junit4]   2> 2153142 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 2153142 INFO  (searcherExecutor-8325-thread-1) [    ] o.a.s.c.SolrCore [testcollection_shard1_replica_n1] Registered new searcher Searcher@cf4c89[testcollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2153143 INFO  (parallelCoreAdminExecutor-8316-thread-1) [    ] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576392563706822656
   [junit4]   2> 2153233 INFO  (zkCallback-2781-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2153233 INFO  (zkCallback-2798-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2153233 INFO  (zkCallback-2780-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2153233 INFO  (zkCallback-2781-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2153233 INFO  (zkCallback-2783-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2153233 INFO  (zkCallback-2783-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2153233 INFO  (zkCallback-2780-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2153233 INFO  (zkCallback-2798-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2153620 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2153620 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2153620 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2/
   [junit4]   2> 2153621 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.u.PeerSync PeerSync: core=testcollection_shard1_replica_n2 url=http://127.0.0.1:38783/solr START replicas=[http://127.0.0.1:33065/solr/testcollection_shard1_replica_n1/] nUpdates=100
   [junit4]   2> 2153622 INFO  (qtp10467983-19947) [    ] o.a.s.c.S.Request [testcollection_shard1_replica_n1]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2153633 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 2153633 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 2153633 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45345/solr/testcollection_shard2_replica_n4/
   [junit4]   2> 2153633 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.u.PeerSync PeerSync: core=testcollection_shard2_replica_n4 url=http://127.0.0.1:45345/solr START replicas=[http://127.0.0.1:43591/solr/testcollection_shard2_replica_n6/] nUpdates=100
   [junit4]   2> 2153634 INFO  (qtp28420368-19927) [    ] o.a.s.c.S.Request [testcollection_shard2_replica_n6]  webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2153729 INFO  (qtp10467983-19922) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2153730 INFO  (qtp10467983-19922) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2153921 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.u.PeerSync PeerSync: core=testcollection_shard1_replica_n2 url=http://127.0.0.1:38783/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 2153921 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 2153921 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 2153921 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2153922 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2/ shard1
   [junit4]   2> 2153933 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.u.PeerSync PeerSync: core=testcollection_shard2_replica_n4 url=http://127.0.0.1:45345/solr DONE.  We have no versions.  sync failed.
   [junit4]   2> 2153933 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
   [junit4]   2> 2153933 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
   [junit4]   2> 2153933 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 2153934 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45345/solr/testcollection_shard2_replica_n4/ shard2
   [junit4]   2> 2154035 INFO  (zkCallback-2781-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154035 INFO  (zkCallback-2798-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154035 INFO  (zkCallback-2798-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154035 INFO  (zkCallback-2783-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154035 INFO  (zkCallback-2780-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154035 INFO  (zkCallback-2780-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154035 INFO  (zkCallback-2781-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154035 INFO  (zkCallback-2783-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154036 INFO  (qtp28420368-19925) [    ] o.a.s.h.a.CoreAdminOperation Checking request status for : cf898f05-846c-48e9-9572-c3573de50a2e2362022274332183
   [junit4]   2> 2154037 INFO  (qtp28420368-19925) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=cf898f05-846c-48e9-9572-c3573de50a2e2362022274332183&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2154073 INFO  (parallelCoreAdminExecutor-8323-thread-1) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2154085 INFO  (parallelCoreAdminExecutor-8310-thread-1) [    ] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 2154247 INFO  (zkCallback-2781-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154247 INFO  (zkCallback-2798-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154247 INFO  (zkCallback-2781-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154247 INFO  (zkCallback-2783-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154247 INFO  (zkCallback-2798-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154247 INFO  (zkCallback-2780-thread-2) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154247 INFO  (zkCallback-2780-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154247 INFO  (zkCallback-2783-thread-1) [    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/testcollection/state.json] for collection [testcollection] has occurred - updating... (live nodes size: [5])
   [junit4]   2> 2154730 INFO  (qtp10467983-19955) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2154731 INFO  (qtp10467983-19955) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2155037 INFO  (qtp28420368-19948) [    ] o.a.s.h.a.CoreAdminOperation Checking request status for : cf898f05-846c-48e9-9572-c3573de50a2e2362022274332183
   [junit4]   2> 2155037 INFO  (qtp28420368-19948) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=cf898f05-846c-48e9-9572-c3573de50a2e2362022274332183&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2155039 INFO  (qtp29099948-19963) [    ] o.a.s.h.a.CoreAdminOperation Checking request status for : cf898f05-846c-48e9-9572-c3573de50a2e2362022273562631
   [junit4]   2> 2155039 INFO  (qtp29099948-19963) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=cf898f05-846c-48e9-9572-c3573de50a2e2362022273562631&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2155040 INFO  (qtp19355274-20050) [    ] o.a.s.h.a.CoreAdminOperation Checking request status for : cf898f05-846c-48e9-9572-c3573de50a2e2362022272888009
   [junit4]   2> 2155040 INFO  (qtp19355274-20050) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=cf898f05-846c-48e9-9572-c3573de50a2e2362022272888009&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2155042 INFO  (qtp10467983-19950) [    ] o.a.s.h.a.CoreAdminOperation Checking request status for : cf898f05-846c-48e9-9572-c3573de50a2e2362022272209619
   [junit4]   2> 2155042 INFO  (qtp10467983-19950) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=cf898f05-846c-48e9-9572-c3573de50a2e2362022272209619&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2155043 INFO  (OverseerThreadFactory-8307-thread-1) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2155729 INFO  (OverseerCollectionConfigSetProcessor-98524535006035983-127.0.0.1:45345_solr-n_0000000000) [    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 2155731 INFO  (qtp10467983-19934) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :requeststatus with params requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=REQUESTSTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2155732 INFO  (qtp10467983-19934) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2155732 INFO  (qtp10467983-19922) [    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :deletestatus with params requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=DELETESTATUS&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 2155732 INFO  (qtp10467983-19922) [    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={requestid=cf898f05-846c-48e9-9572-c3573de50a2e&action=DELETESTATUS&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2155732 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: testcollection failOnTimeout:true timeout (sec):330
   [junit4]   1> -
   [junit4]   1> replica:core_node3 rstate:active live:true
   [junit4]   1> replica:core_node5 rstate:active live:true
   [junit4]   1> replica:core_node7 rstate:active live:true
   [junit4]   1> replica:core_node8 rstate:active live:true
   [junit4]   1> no one is recoverying
   [junit4]   2> 2155733 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: testcollection
   [junit4]   2> 2155737 INFO  (qtp10467983-19926) [    ] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2/&wt=javabin&version=2}{add=[1 (1576392566423683072)]} 0 0
   [junit4]   2> 2155737 INFO  (qtp19355274-20045) [    ] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n2]  webapp=/solr path=/update params={_stateVer_=testcollection:5&wt=javabin&version=2}{add=[1 (1576392566423683072)]} 0 3
   [junit4]   2> 2155737 INFO  (qtp10467983-19950) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576392566426828800,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2155737 INFO  (qtp10467983-19950) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@926d00 commitCommandVersion:1576392566426828800
   [junit4]   2> 2155738 INFO  (qtp29099948-19957) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576392566427877376,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2155742 INFO  (qtp29099948-19957) [    ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 2155743 INFO  (qtp19355274-20044) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576392566433120256,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2155743 INFO  (qtp19355274-20044) [    ] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@8a4807 commitCommandVersion:1576392566433120256
   [junit4]   2> 2155743 INFO  (qtp29099948-19957) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2155743 INFO  (qtp29099948-19957) [    ] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard2_replica_n4]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 5
   [junit4]   2> 2155743 INFO  (qtp28420368-19927) [    ] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576392566433120256,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2155743 INFO  (qtp28420368-19927) [    ] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 2155744 INFO  (qtp28420368-19927) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2155744 INFO  (qtp28420368-19927) [    ] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard2_replica_n6]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
   [junit4]   2> 2155978 INFO  (qtp19355274-20044) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@15be097[testcollection_shard1_replica_n2] main]
   [junit4]   2> 2155979 INFO  (qtp19355274-20044) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2155980 INFO  (searcherExecutor-8328-thread-1) [    ] o.a.s.c.SolrCore [testcollection_shard1_replica_n2] Registered new searcher Searcher@15be097[testcollection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
   [junit4]   2> 2155980 INFO  (qtp19355274-20044) [    ] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n2]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 237
   [junit4]   2> 2155983 INFO  (qtp10467983-19950) [    ] o.a.s.s.SolrIndexSearcher Opening [Searcher@ca972f[testcollection_shard1_replica_n1] main]
   [junit4]   2> 2155983 INFO  (qtp10467983-19950) [    ] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2155984 INFO  (searcherExecutor-8325-thread-1) [    ] o.a.s.c.SolrCore [testcollection_shard1_replica_n1] Registered new searcher Searcher@ca972f[testcollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C1)))}
   [junit4]   2> 2155984 INFO  (qtp10467983-19950) [    ] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n1]  webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 246
   [junit4]   2> 2155984 INFO  (qtp19355274-20049) [    ] o.a.s.u.p.LogUpdateProcessorFactory [testcollection_shard1_replica_n2]  webapp=/solr path=/update params={_stateVer_=testcollection:5&commit=true&wt=javabin&version=2}{commit=} 0 246
   [junit4]   2> 2155985 INFO  (qtp28420368-19948) [    ] o.a.s.c.S.Request [testcollection_shard2_replica_n6]  webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=testcollection:5&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:43591/solr/testcollection_shard2_replica_n6/|http://127.0.0.1:45345/solr/testcollection_shard2_replica_n4/&rows=10&version=2&q=*:*&NOW=1503365103422&isShard=true&wt=javabin} hits=0 status=0 QTime=0
   [junit4]   2> 2155986 INFO  (qtp19355274-20046) [    ] o.a.s.c.S.Request [testcollection_shard1_replica_n2]  webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=testcollection:5&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2/|http://127.0.0.1:33065/solr/testcollection_shard1_replica_n1/&rows=10&version=2&q=*:*&NOW=1503365103422&isShard=true&wt=javabin} hits=1 status=0 QTime=0
   [junit4]   2> 2155986 INFO  (qtp19355274-20044) [    ] o.a.s.c.S.Request [testcollection_shard1_replica_n2]  webapp=/solr path=/select params={q=*:*&df=text&distrib=false&_stateVer_=testcollection:5&shards.purpose=64&NOW=1503365103422&ids=1&isShard=true&shard.url=http://127.0.0.1:38783/solr/testcollection_shard1_replica_n2/|http://127.0.0.1:33065/solr/testcollection_shard1_replica_n1/&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2155986 INFO  (qtp10467983-19955) [    ] o.a.s.c.S.Request [testcollection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&_stateVer_=testcollection:5&wt=javabin&version=2} hits=1 status=0 QTime=2
   [junit4]   2> 2155988 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@70afa5{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 2155988 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=13591924
   [junit4]   2> 2155988 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 2155988 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1737239: rootName = solr_36639, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1e1579d
   [junit4]   2> 2155993 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 2155993 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@5ed6b7: rootName = solr_36639, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@15449bb
   [junit4]   2> 2155997 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testCollectionCreateSearchDelete-seed#[4DA56F9A8281768B]) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 2155997

[...truncated too long message...]


   [junit4]   2> 2195189 INFO  (coreCloseExecutor-8526-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.testStopAllStartAllCollection.shard2.leader, tag=607487
   [junit4]   2> 2196678 WARN  (zkCallback-2871-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2196679 INFO  (jetty-closer-2844-thread-4) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@32bd77{/solr,null,UNAVAILABLE}
   [junit4]   2> 2196688 WARN  (zkCallback-2896-thread-2) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2196688 WARN  (zkCallback-2884-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2196688 WARN  (zkCallback-2890-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2196688 INFO  (jetty-closer-2844-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@163d27f{/solr,null,UNAVAILABLE}
   [junit4]   2> 2196688 INFO  (jetty-closer-2844-thread-3) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@f11f17{/solr,null,UNAVAILABLE}
   [junit4]   2> 2196688 INFO  (jetty-closer-2844-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@16f819{/solr,null,UNAVAILABLE}
   [junit4]   2> 2196690 WARN  (zkCallback-2902-thread-1) [    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 2196690 INFO  (jetty-closer-2844-thread-5) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@16f3e8c{/solr,null,UNAVAILABLE}
   [junit4]   2> 2196691 ERROR (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[4DA56F9A8281768B]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 2196691 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[4DA56F9A8281768B]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37521 37521
   [junit4]   2> 2201723 INFO  (Thread-5827) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37521 37521
   [junit4]   2> 2201723 WARN  (Thread-5827) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/aliases.json
   [junit4]   2> 	10	/solr/clusterprops.json
   [junit4]   2> 	9	/solr/security.json
   [junit4]   2> 	8	/solr/configs/solrCloudCollectionConfig
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	78	/solr/collections/testStopAllStartAllCollection/state.json
   [junit4]   2> 	10	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/overseer_elect/election/98524536757878799-127.0.0.1:34683_solr-n_0000000000
   [junit4]   2> 	2	/solr/overseer_elect/election/98524536757878795-127.0.0.1:45833_solr-n_0000000002
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	10	/solr/collections
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 
   [junit4]   2> 2201723 INFO  (TEST-TestCollectionsAPIViaSolrCloudCluster.testStopAllStartAll-seed#[4DA56F9A8281768B]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testStopAllStartAll
   [junit4]   2> 2201724 INFO  (SUITE-TestCollectionsAPIViaSolrCloudCluster-seed#[4DA56F9A8281768B]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:37521 37521
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestCollectionsAPIViaSolrCloudCluster_4DA56F9A8281768B-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {id=PostingsFormat(name=Memory)}, docValues:{_version_=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=943, maxMBSortInHeap=6.667096360312081, sim=RandomSimilarity(queryNorm=false): {}, locale=haw, timezone=CAT
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 9 (32-bit)/cpus=8,threads=1,free=164196624,total=500695040
   [junit4]   2> NOTE: All tests run in this JVM: [TestPerFieldSimilarity, ZkSolrClientTest, TestImpersonationWithHadoopAuth, TestImplicitCoreProperties, TestSubQueryTransformerCrossCore, SparseHLLTest, MultiThreadedOCPTest, TestNumericRangeQuery64, ZkControllerTest, DirectoryFactoryTest, TestRebalanceLeaders, SegmentsInfoRequestHandlerTest, NoCacheHeaderTest, DocValuesMissingTest, TestQueryTypes, ReplaceNodeTest, TestPostingsSolrHighlighter, SolrIndexMetricsTest, TestFieldCollectionResource, UninvertDocValuesMergePolicyTest, TestStressUserVersions, CachingDirectoryFactoryTest, TestSolrCloudSnapshots, SolrMetricManagerTest, RollingRestartTest, TestClassicSimilarityFactory, TestSolrCloudWithKerberosAlt, TestIntervalFaceting, ClusterStateUpdateTest, CoreAdminHandlerTest, TestCursorMarkWithoutUniqueKey, SliceStateTest, TestFieldTypeResource, TestUninvertingReader, JsonLoaderTest, SolrJmxReporterTest, TestCollationFieldDocValues, PreAnalyzedFieldManagedSchemaCloudTest, LeaderFailoverAfterPartitionTest, StatelessScriptUpdateProcessorFactoryTest, OpenCloseCoreStressTest, DistanceFunctionTest, ResourceLoaderTest, DistanceUnitsTest, TestBinaryResponseWriter, SpellCheckComponentTest, TestCoreContainer, TestLegacyNumericRangeQueryBuilder, TestSolrCoreParser, TestRandomCollapseQParserPlugin, HdfsChaosMonkeyNothingIsSafeTest, TestManagedSynonymGraphFilterFactory, TestDistribIDF, SOLR749Test, TestUniqueKeyFieldResource, DirectSolrSpellCheckerTest, QueryResultKeyTest, DistributedTermsComponentTest, TestMultiWordSynonyms, CdcrBootstrapTest, TestConfigSetsAPI, TestShortCircuitedRequests, TestXmlQParserPlugin, TestRuleBasedAuthorizationPlugin, RankQueryTest, DocValuesTest, DistributedDebugComponentTest, PrimUtilsTest, AnalysisAfterCoreReloadTest, SampleTest, TestHdfsUpdateLog, TestJsonRequest, CollectionsAPIDistributedZkTest, TestCharFilters, TestStressVersions, ShardSplitTest, TestElisionMultitermQuery, LeaderInitiatedRecoveryOnShardRestartTest, TestSchemaSimilarityResource, DistributedVersionInfoTest, TestLeaderElectionWithEmptyReplica, DistributedFacetPivotSmallTest, CacheHeaderTest, CSVRequestHandlerTest, ActionThrottleTest, HttpSolrCallGetCoreTest, TestNRTOpen, TestFastLRUCache, SolrCmdDistributorTest, TestSolrConfigHandlerCloud, TestLocalFSCloudBackupRestore, TestClusterProperties, TestValueSourceCache, ConcurrentDeleteAndCreateCollectionTest, TriLevelCompositeIdRoutingTest, TestCoreDiscovery, ShardRoutingCustomTest, SpatialHeatmapFacetsTest, QueryParsingTest, DistributedQueryComponentOptimizationTest, TestCopyFieldCollectionResource, CloudExitableDirectoryReaderTest, DisMaxRequestHandlerTest, UpdateLogTest, FullHLLTest, TestLegacyField, AtomicUpdateProcessorFactoryTest, TestLRUStatsCache, TestOnReconnectListenerSupport, TestHdfsBackupRestoreCore, FileUtilsTest, OverseerRolesTest, TestCloudInspectUtil, TestCustomSort, TestStressInPlaceUpdates, TestNamedUpdateProcessors, SimpleCollectionCreateDeleteTest, TestRTGBase, ConvertedLegacyTest, SchemaVersionSpecificBehaviorTest, TestNestedDocsSort, UpdateRequestProcessorFactoryTest, DistributedQueryElevationComponentTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SuggesterFSTTest, SolrRequestParserTest, SuggesterTSTTest, SpatialFilterTest, WordBreakSolrSpellCheckerTest, TestUpdate, TestAtomicUpdateErrorCases, TestWordDelimiterFilterFactory, QueryEqualityTest, DocValuesMultiTest, TestSolrDeletionPolicy1, SolrInfoBeanTest, DebugComponentTest, LukeRequestHandlerTest, TestQueryUtils, PrimitiveFieldTypeTest, TestOmitPositions, FileBasedSpellCheckerTest, TermsComponentTest, XmlUpdateRequestHandlerTest, PathHierarchyTokenizerFactoryTest, TermVectorComponentTest, TestIndexingPerformance, MoreLikeThisHandlerTest, FastVectorHighlighterTest, IndexSchemaRuntimeFieldTest, LoggingHandlerTest, RegexBoostProcessorTest, SolrPluginUtilsTest, IndexSchemaTest, BinaryUpdateRequestHandlerTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, TestComponentsName, TestLFUCache, TestMergePolicyConfig, TestSolrDeletionPolicy2, MultiTermTest, TestSearchPerf, NumericFieldsTest, TestConfig, TestFuzzyAnalyzedSuggestions, ExternalFileFieldSortTest, DirectSolrConnectionTest, NotRequiredUniqueKeyTest, TestLuceneMatchVersion, TestCodecSupport, TestLMDirichletSimilarityFactory, TestBM25SimilarityFactory, TimeZoneUtilsTest, URLClassifyProcessorTest, PreAnalyzedFieldTest, TestSystemIdResolver, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, ClusterStateTest, TestSolrJ, TestLRUCache, SystemInfoHandlerTest, UUIDFieldTest, DistributedMLTComponentTest, DistributedIntervalFacetingTest, TestCrossCoreJoin, TestDistributedMissingSort, TestSimpleTrackingShardHandler, TestEmbeddedSolrServerConstructors, TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, AliasIntegrationTest, AssignTest, AsyncCallRequestStatusResponseTest, BaseCdcrDistributedZkTest, CdcrRequestHandlerTest, CdcrVersionReplicationTest, CollectionStateFormat2Test, CollectionTooManyReplicasTest, CollectionsAPISolrJTest, DeleteNodeTest, DeleteShardTest, DistribDocExpirationUpdateProcessorTest, HealthCheckHandlerTest, HttpPartitionTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerStatusTest, PeerSyncReplicationTest, TestAuthenticationFramework, TestCloudPivotFacet, TestCollectionsAPIViaSolrCloudCluster]
   [junit4] Completed [544/730 (1!)] on J1 in 52.04s, 3 tests, 1 error <<< FAILURES!

[...truncated 37101 lines...]

[JENKINS] Lucene-Solr-master-Linux (32bit/jdk1.8.0_144) - Build # 20355 - Still Unstable!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Linux/20355/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseParallelGC

1 tests failed.
FAILED:  org.apache.solr.cloud.HttpPartitionTest.test

Error Message:
Doc with id=1 not found in http://127.0.0.1:36769/m_w/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}

Stack Trace:
java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:36769/m_w/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
	at __randomizedtesting.SeedInfo.seed([D31F5E8D9AE0F05:8565CA32775262FD]:0)
	at org.junit.Assert.fail(Assert.java:93)
	at org.junit.Assert.assertTrue(Assert.java:43)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
	at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
	at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
	at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
	at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
	at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
	at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
	at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
	at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
	at java.lang.Thread.run(Thread.java:748)




Build Log:
[...truncated 10969 lines...]
   [junit4] Suite: org.apache.solr.cloud.HttpPartitionTest
   [junit4]   2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/init-core-data-001
   [junit4]   2> 202544 WARN  (SUITE-HttpPartitionTest-seed#[D31F5E8D9AE0F05]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 202544 INFO  (SUITE-HttpPartitionTest-seed#[D31F5E8D9AE0F05]-worker) [    ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
   [junit4]   2> 202545 INFO  (SUITE-HttpPartitionTest-seed#[D31F5E8D9AE0F05]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
   [junit4]   2> 202545 INFO  (SUITE-HttpPartitionTest-seed#[D31F5E8D9AE0F05]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 202545 INFO  (SUITE-HttpPartitionTest-seed#[D31F5E8D9AE0F05]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /m_w/
   [junit4]   2> 202547 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 202548 INFO  (Thread-537) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 202548 INFO  (Thread-537) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 202549 ERROR (Thread-537) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 202648 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.ZkTestServer start zk server on port:44917
   [junit4]   2> 202653 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
   [junit4]   2> 202654 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/schema.xml to /configs/conf1/schema.xml
   [junit4]   2> 202654 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
   [junit4]   2> 202655 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
   [junit4]   2> 202655 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
   [junit4]   2> 202656 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
   [junit4]   2> 202656 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
   [junit4]   2> 202656 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
   [junit4]   2> 202657 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
   [junit4]   2> 202657 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
   [junit4]   2> 202657 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
   [junit4]   2> 202658 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Will use TLOG replicas unless explicitly asked otherwise
   [junit4]   2> 202717 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 202717 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28d244{/m_w,null,AVAILABLE}
   [junit4]   2> 202718 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@201e44{HTTP/1.1,[http/1.1]}{127.0.0.1:36377}
   [junit4]   2> 202718 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.Server Started @204274ms
   [junit4]   2> 202718 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/tempDir-001/control/data, hostContext=/m_w, hostPort=33981, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/control-001/cores}
   [junit4]   2> 202718 ERROR (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 202718 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 202718 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 202718 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 202718 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-21T18:54:14.806Z
   [junit4]   2> 202720 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 202720 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/control-001/solr.xml
   [junit4]   2> 202723 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 202726 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44917/solr
   [junit4]   2> 202752 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:33981_m_w    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 202752 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:33981_m_w    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:33981_m_w
   [junit4]   2> 202752 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:33981_m_w    ] o.a.s.c.Overseer Overseer (id=98522998678224900-127.0.0.1:33981_m_w-n_0000000000) starting
   [junit4]   2> 202755 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:33981_m_w    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:33981_m_w
   [junit4]   2> 202755 INFO  (zkCallback-311-thread-1-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 202868 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:33981_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 202874 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:33981_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 202874 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:33981_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 202875 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:33981_m_w    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/control-001/cores
   [junit4]   2> 202889 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 202889 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44917/solr ready
   [junit4]   2> 202890 INFO  (SocketProxy-Acceptor-33981) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=59266,localport=33981], receiveBufferSize:531000
   [junit4]   2> 202901 INFO  (SocketProxy-Acceptor-33981) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36377,localport=53550], receiveBufferSize=530904
   [junit4]   2> 202901 INFO  (qtp21158870-2056) [n:127.0.0.1:33981_m_w    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:33981_m_w&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 202902 INFO  (OverseerThreadFactory-1123-thread-1-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.CreateCollectionCmd Create collection control_collection
   [junit4]   2> 203006 INFO  (SocketProxy-Acceptor-33981) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=59270,localport=33981], receiveBufferSize:531000
   [junit4]   2> 203008 INFO  (SocketProxy-Acceptor-33981) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36377,localport=53554], receiveBufferSize=530904
   [junit4]   2> 203008 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 203008 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 203111 INFO  (zkCallback-311-thread-1-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 204025 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 204039 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
   [junit4]   2> 204090 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 204097 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
   [junit4]   2> 204097 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 204097 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 204097 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/control-001/cores/control_collection_shard1_replica_n1/data/]
   [junit4]   2> 204099 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=14.224609375, floorSegmentMB=0.203125, forceMergeDeletesPctAllowed=29.913688797449645, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 204101 WARN  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 204126 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 204126 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 204127 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 204127 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 204128 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7435781152372346]
   [junit4]   2> 204128 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1706190[control_collection_shard1_replica_n1] main]
   [junit4]   2> 204129 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 204129 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 204129 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 204130 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576367980510445568
   [junit4]   2> 204130 INFO  (searcherExecutor-1126-thread-1-processing-n:127.0.0.1:33981_m_w x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@1706190[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 204132 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 204132 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 204132 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:33981/m_w/control_collection_shard1_replica_n1/
   [junit4]   2> 204132 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 204133 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:33981/m_w/control_collection_shard1_replica_n1/ has no replicas
   [junit4]   2> 204133 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 204134 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:33981/m_w/control_collection_shard1_replica_n1/ shard1
   [junit4]   2> 204235 INFO  (zkCallback-311-thread-1-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 204284 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 204286 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w c:control_collection s:shard1  x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1277
   [junit4]   2> 204289 INFO  (qtp21158870-2056) [n:127.0.0.1:33981_m_w    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 204389 INFO  (zkCallback-311-thread-1-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
   [junit4]   2> 204904 INFO  (OverseerCollectionConfigSetProcessor-98522998678224900-127.0.0.1:33981_m_w-n_0000000000) [n:127.0.0.1:33981_m_w    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 205289 INFO  (qtp21158870-2056) [n:127.0.0.1:33981_m_w    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:33981_m_w&wt=javabin&version=2} status=0 QTime=2387
   [junit4]   2> 205294 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 205294 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:44917/solr ready
   [junit4]   2> 205294 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
   [junit4]   2> 205295 INFO  (SocketProxy-Acceptor-33981) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=59290,localport=33981], receiveBufferSize:531000
   [junit4]   2> 205298 INFO  (SocketProxy-Acceptor-33981) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=36377,localport=53574], receiveBufferSize=530904
   [junit4]   2> 205299 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 205300 INFO  (OverseerThreadFactory-1123-thread-2-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.CreateCollectionCmd Create collection collection1
   [junit4]   2> 205300 WARN  (OverseerThreadFactory-1123-thread-2-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
   [junit4]   2> 205502 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 205502 INFO  (qtp21158870-2058) [n:127.0.0.1:33981_m_w    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=2&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=203
   [junit4]   2> 205562 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-1-001 of type TLOG
   [junit4]   2> 205562 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 205563 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6818db{/m_w,null,AVAILABLE}
   [junit4]   2> 205563 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@e60df0{HTTP/1.1,[http/1.1]}{127.0.0.1:35543}
   [junit4]   2> 205563 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.Server Started @207120ms
   [junit4]   2> 205563 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/tempDir-001/jetty1, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/m_w, hostPort=36769, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-1-001/cores}
   [junit4]   2> 205564 ERROR (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 205564 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 205564 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 205564 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 205564 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-21T18:54:17.652Z
   [junit4]   2> 205566 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 205566 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-1-001/solr.xml
   [junit4]   2> 205568 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 205570 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44917/solr
   [junit4]   2> 205574 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:36769_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 205574 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:36769_m_w    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 205575 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:36769_m_w    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:36769_m_w
   [junit4]   2> 205576 INFO  (zkCallback-318-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 205576 INFO  (zkCallback-311-thread-1-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 205576 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36769_m_w) [n:127.0.0.1:36769_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 205619 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:36769_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 205626 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:36769_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 205626 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:36769_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 205628 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:36769_m_w    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-1-001/cores
   [junit4]   2> 205648 INFO  (SocketProxy-Acceptor-36769) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38394,localport=36769], receiveBufferSize:531000
   [junit4]   2> 205648 INFO  (SocketProxy-Acceptor-36769) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35543,localport=50634], receiveBufferSize=530904
   [junit4]   2> 205649 INFO  (qtp29713451-2104) [n:127.0.0.1:36769_m_w    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:36769_m_w&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 205653 INFO  (OverseerCollectionConfigSetProcessor-98522998678224900-127.0.0.1:33981_m_w-n_0000000000) [n:127.0.0.1:33981_m_w    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 205653 INFO  (OverseerThreadFactory-1123-thread-3-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:36769_m_w for creating new replica
   [junit4]   2> 205654 INFO  (SocketProxy-Acceptor-36769) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38398,localport=36769], receiveBufferSize:531000
   [junit4]   2> 205654 INFO  (SocketProxy-Acceptor-36769) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35543,localport=50638], receiveBufferSize=530904
   [junit4]   2> 205655 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 205655 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 205761 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36769_m_w) [n:127.0.0.1:36769_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 206663 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 206675 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema [collection1_shard2_replica_t41] Schema name=test
   [junit4]   2> 206724 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 206731 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t41' using configuration from collection collection1, trusted=true
   [junit4]   2> 206732 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t41' (registry 'solr.core.collection1.shard2.replica_t41') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 206732 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 206732 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [[collection1_shard2_replica_t41] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-1-001/cores/collection1_shard2_replica_t41], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-1-001/cores/collection1_shard2_replica_t41/data/]
   [junit4]   2> 206734 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=14.224609375, floorSegmentMB=0.203125, forceMergeDeletesPctAllowed=29.913688797449645, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 206735 WARN  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 206760 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 206760 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 206761 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 206761 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 206761 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7435781152372346]
   [junit4]   2> 206762 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.SolrIndexSearcher Opening [Searcher@925c21[collection1_shard2_replica_t41] main]
   [junit4]   2> 206763 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 206763 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 206763 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 206764 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576367983272394752
   [junit4]   2> 206764 INFO  (searcherExecutor-1137-thread-1-processing-n:127.0.0.1:36769_m_w x:collection1_shard2_replica_t41 s:shard2 c:collection1) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SolrCore [collection1_shard2_replica_t41] Registered new searcher Searcher@925c21[collection1_shard2_replica_t41] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 206767 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 206767 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 206767 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:36769/m_w/collection1_shard2_replica_t41/
   [junit4]   2> 206767 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 206767 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.SyncStrategy http://127.0.0.1:36769/m_w/collection1_shard2_replica_t41/ has no replicas
   [junit4]   2> 206767 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 206767 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController collection1_shard2_replica_t41 stopping background replication from leader
   [junit4]   2> 206769 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:36769/m_w/collection1_shard2_replica_t41/ shard2
   [junit4]   2> 206870 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36769_m_w) [n:127.0.0.1:36769_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 206919 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 206921 INFO  (qtp29713451-2106) [n:127.0.0.1:36769_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t41] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t41&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1266
   [junit4]   2> 206924 INFO  (qtp29713451-2104) [n:127.0.0.1:36769_m_w    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:36769_m_w&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1274
   [junit4]   2> 207006 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-2-001 of type TLOG
   [junit4]   2> 207006 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 207007 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@460247{/m_w,null,AVAILABLE}
   [junit4]   2> 207007 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@e24e10{HTTP/1.1,[http/1.1]}{127.0.0.1:45365}
   [junit4]   2> 207008 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.Server Started @208564ms
   [junit4]   2> 207008 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/tempDir-001/jetty2, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/m_w, hostPort=46785, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-2-001/cores}
   [junit4]   2> 207008 ERROR (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 207008 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 207008 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 207008 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 207008 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-21T18:54:19.096Z
   [junit4]   2> 207010 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 207011 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-2-001/solr.xml
   [junit4]   2> 207013 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 207015 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44917/solr
   [junit4]   2> 207020 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:46785_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 207021 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:46785_m_w    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 207021 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:46785_m_w    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:46785_m_w
   [junit4]   2> 207022 INFO  (zkCallback-318-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 207022 INFO  (zkCallback-311-thread-2-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 207022 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36769_m_w) [n:127.0.0.1:36769_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 207022 INFO  (zkCallback-329-thread-1-processing-n:127.0.0.1:46785_m_w) [n:127.0.0.1:46785_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
   [junit4]   2> 207061 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:46785_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 207068 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:46785_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 207068 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:46785_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 207069 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:46785_m_w    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-2-001/cores
   [junit4]   2> 207089 INFO  (qtp29713451-2105) [n:127.0.0.1:36769_m_w    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:46785_m_w&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 207091 INFO  (OverseerCollectionConfigSetProcessor-98522998678224900-127.0.0.1:33981_m_w-n_0000000000) [n:127.0.0.1:33981_m_w    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 207091 INFO  (OverseerThreadFactory-1123-thread-4-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:46785_m_w for creating new replica
   [junit4]   2> 207092 INFO  (SocketProxy-Acceptor-46785) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=34198,localport=46785], receiveBufferSize:531000
   [junit4]   2> 207092 INFO  (SocketProxy-Acceptor-46785) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=45365,localport=34872], receiveBufferSize=530904
   [junit4]   2> 207093 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 207093 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 207196 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36769_m_w) [n:127.0.0.1:36769_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 207196 INFO  (zkCallback-329-thread-1-processing-n:127.0.0.1:46785_m_w) [n:127.0.0.1:46785_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 208103 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 208112 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema [collection1_shard1_replica_t43] Schema name=test
   [junit4]   2> 208165 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 208173 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_t43' using configuration from collection collection1, trusted=true
   [junit4]   2> 208173 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_t43' (registry 'solr.core.collection1.shard1.replica_t43') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 208173 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 208173 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [[collection1_shard1_replica_t43] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-2-001/cores/collection1_shard1_replica_t43], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-2-001/cores/collection1_shard1_replica_t43/data/]
   [junit4]   2> 208176 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=14.224609375, floorSegmentMB=0.203125, forceMergeDeletesPctAllowed=29.913688797449645, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 208180 WARN  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 208221 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 208221 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 208222 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 208222 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 208223 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7435781152372346]
   [junit4]   2> 208223 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.SolrIndexSearcher Opening [Searcher@aeae8e[collection1_shard1_replica_t43] main]
   [junit4]   2> 208224 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 208224 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 208224 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 208225 INFO  (searcherExecutor-1148-thread-1-processing-n:127.0.0.1:46785_m_w x:collection1_shard1_replica_t43 s:shard1 c:collection1) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SolrCore [collection1_shard1_replica_t43] Registered new searcher Searcher@aeae8e[collection1_shard1_replica_t43] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 208225 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576367984804364288
   [junit4]   2> 208228 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 208228 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 208228 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:46785/m_w/collection1_shard1_replica_t43/
   [junit4]   2> 208228 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 208228 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.SyncStrategy http://127.0.0.1:46785/m_w/collection1_shard1_replica_t43/ has no replicas
   [junit4]   2> 208228 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 208228 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController collection1_shard1_replica_t43 stopping background replication from leader
   [junit4]   2> 208229 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:46785/m_w/collection1_shard1_replica_t43/ shard1
   [junit4]   2> 208331 INFO  (zkCallback-329-thread-1-processing-n:127.0.0.1:46785_m_w) [n:127.0.0.1:46785_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 208331 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36769_m_w) [n:127.0.0.1:36769_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 208380 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 208382 INFO  (qtp26268127-2139) [n:127.0.0.1:46785_m_w c:collection1 s:shard1  x:collection1_shard1_replica_t43] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_t43&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1288
   [junit4]   2> 208384 INFO  (qtp29713451-2105) [n:127.0.0.1:36769_m_w    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:46785_m_w&action=ADDREPLICA&collection=collection1&shard=shard1&type=TLOG&wt=javabin&version=2} status=0 QTime=1294
   [junit4]   2> 208464 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-3-001 of type TLOG
   [junit4]   2> 208465 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.Server jetty-9.3.20.v20170531
   [junit4]   2> 208465 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@a6f516{/m_w,null,AVAILABLE}
   [junit4]   2> 208466 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@f9c99d{HTTP/1.1,[http/1.1]}{127.0.0.1:40925}
   [junit4]   2> 208466 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.Server Started @210023ms
   [junit4]   2> 208466 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/tempDir-001/jetty3, replicaType=TLOG, solrconfig=solrconfig.xml, hostContext=/m_w, hostPort=37479, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-3-001/cores}
   [junit4]   2> 208466 ERROR (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 208466 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr? version 8.0.0
   [junit4]   2> 208466 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 208466 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null, Default config dir: null
   [junit4]   2> 208466 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2017-08-21T18:54:20.554Z
   [junit4]   2> 208468 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
   [junit4]   2> 208469 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-3-001/solr.xml
   [junit4]   2> 208471 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 208475 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:44917/solr
   [junit4]   2> 208482 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:37479_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
   [junit4]   2> 208483 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:37479_m_w    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 208483 INFO  (zkCallback-329-thread-1-processing-n:127.0.0.1:46785_m_w) [n:127.0.0.1:46785_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 208483 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36769_m_w) [n:127.0.0.1:36769_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
   [junit4]   2> 208485 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:37479_m_w    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37479_m_w
   [junit4]   2> 208485 INFO  (zkCallback-318-thread-1) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 208485 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36769_m_w) [n:127.0.0.1:36769_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 208485 INFO  (zkCallback-311-thread-2-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 208485 INFO  (zkCallback-329-thread-1-processing-n:127.0.0.1:46785_m_w) [n:127.0.0.1:46785_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 208485 INFO  (zkCallback-335-thread-1-processing-n:127.0.0.1:37479_m_w) [n:127.0.0.1:37479_m_w    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
   [junit4]   2> 208539 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:37479_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 208546 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:37479_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 208546 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:37479_m_w    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 208547 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [n:127.0.0.1:37479_m_w    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-3-001/cores
   [junit4]   2> 208575 INFO  (qtp29713451-2100) [n:127.0.0.1:36769_m_w    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:37479_m_w&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 208576 INFO  (OverseerCollectionConfigSetProcessor-98522998678224900-127.0.0.1:33981_m_w-n_0000000000) [n:127.0.0.1:33981_m_w    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 208576 INFO  (OverseerThreadFactory-1123-thread-5-processing-n:127.0.0.1:33981_m_w) [n:127.0.0.1:33981_m_w    ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:37479_m_w for creating new replica
   [junit4]   2> 208577 INFO  (SocketProxy-Acceptor-37479) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38586,localport=37479], receiveBufferSize:531000
   [junit4]   2> 208577 INFO  (SocketProxy-Acceptor-37479) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=40925,localport=56746], receiveBufferSize=530904
   [junit4]   2> 208578 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG
   [junit4]   2> 208579 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
   [junit4]   2> 208681 INFO  (zkCallback-329-thread-1-processing-n:127.0.0.1:46785_m_w) [n:127.0.0.1:46785_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 208681 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36769_m_w) [n:127.0.0.1:36769_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 208681 INFO  (zkCallback-335-thread-1-processing-n:127.0.0.1:37479_m_w) [n:127.0.0.1:37479_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 209592 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 209600 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema [collection1_shard2_replica_t45] Schema name=test
   [junit4]   2> 209652 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 209659 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_t45' using configuration from collection collection1, trusted=true
   [junit4]   2> 209659 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_t45' (registry 'solr.core.collection1.shard2.replica_t45') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1f2b25b
   [junit4]   2> 209660 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 209660 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [[collection1_shard2_replica_t45] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-3-001/cores/collection1_shard2_replica_t45], dataDir=[/home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001/shard-3-001/cores/collection1_shard2_replica_t45/data/]
   [junit4]   2> 209662 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=27, maxMergeAtOnceExplicit=33, maxMergedSegmentMB=14.224609375, floorSegmentMB=0.203125, forceMergeDeletesPctAllowed=29.913688797449645, segmentsPerTier=36.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
   [junit4]   2> 209664 WARN  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
   [junit4]   2> 209691 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 209691 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 209692 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 209692 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 209693 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=22, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7435781152372346]
   [junit4]   2> 209693 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.SolrIndexSearcher Opening [Searcher@1a387b7[collection1_shard2_replica_t45] main]
   [junit4]   2> 209694 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
   [junit4]   2> 209694 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
   [junit4]   2> 209694 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Commits will be reserved for  10000
   [junit4]   2> 209695 INFO  (searcherExecutor-1159-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.SolrCore [collection1_shard2_replica_t45] Registered new searcher Searcher@1a387b7[collection1_shard2_replica_t45] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 209695 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1576367986345771008
   [junit4]   2> 209698 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_t45
   [junit4]   2> 209698 INFO  (updateExecutor-332-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.DefaultSolrCoreState Running recovery
   [junit4]   2> 209698 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
   [junit4]   2> 209699 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
   [junit4]   2> 209699 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.ZkController collection1_shard2_replica_t45 stopping background replication from leader
   [junit4]   2> 209699 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_t45]
   [junit4]   2> 209699 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
   [junit4]   2> 209699 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_t45] as recovering, leader is [http://127.0.0.1:36769/m_w/collection1_shard2_replica_t41/] and I am [http://127.0.0.1:37479/m_w/collection1_shard2_replica_t45/]
   [junit4]   2> 209700 INFO  (qtp15304468-2171) [n:127.0.0.1:37479_m_w c:collection1 s:shard2  x:collection1_shard2_replica_t45] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_t45&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=TLOG} status=0 QTime=1121
   [junit4]   2> 209701 INFO  (qtp29713451-2100) [n:127.0.0.1:36769_m_w    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:37479_m_w&action=ADDREPLICA&collection=collection1&shard=shard2&type=TLOG&wt=javabin&version=2} status=0 QTime=1126
   [junit4]   2> 209702 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:36769/m_w]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_t41&nodeName=127.0.0.1:37479_m_w&coreNodeName=core_node46&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
   [junit4]   2> 209702 INFO  (SocketProxy-Acceptor-36769) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38444,localport=36769], receiveBufferSize:531000
   [junit4]   2> 209702 INFO  (SocketProxy-Acceptor-36769) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35543,localport=50684], receiveBufferSize=530904
   [junit4]   2> 209709 INFO  (qtp29713451-2101) [n:127.0.0.1:36769_m_w    ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
   [junit4]   2> 209709 INFO  (qtp29713451-2101) [n:127.0.0.1:36769_m_w    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:37479_m_w, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:37479/m_w","node_name":"127.0.0.1:37479_m_w","state":"down","type":"TLOG"}
   [junit4]   2> 209710 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 209710 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractFullDistribZkTestBase Wait for recoveries to finish - wait 30000 for each attempt
   [junit4]   2> 209710 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30000
   [junit4]   2> 209802 INFO  (zkCallback-329-thread-1-processing-n:127.0.0.1:46785_m_w) [n:127.0.0.1:46785_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 209802 INFO  (zkCallback-335-thread-1-processing-n:127.0.0.1:37479_m_w) [n:127.0.0.1:37479_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 209802 INFO  (zkCallback-323-thread-1-processing-n:127.0.0.1:36769_m_w) [n:127.0.0.1:36769_m_w    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
   [junit4]   2> 210578 INFO  (OverseerCollectionConfigSetProcessor-98522998678224900-127.0.0.1:33981_m_w-n_0000000000) [n:127.0.0.1:33981_m_w    ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist.  Requestor may have disconnected from ZooKeeper
   [junit4]   2> 210709 INFO  (qtp29713451-2101) [n:127.0.0.1:36769_m_w    ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_t41, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=recovering, localState=active, nodeName=127.0.0.1:37479_m_w, coreNodeName=core_node46, onlyIfActiveCheckResult=false, nodeProps: core_node46:{"core":"collection1_shard2_replica_t45","base_url":"http://127.0.0.1:37479/m_w","node_name":"127.0.0.1:37479_m_w","state":"recovering","type":"TLOG"}
   [junit4]   2> 210710 INFO  (qtp29713451-2101) [n:127.0.0.1:36769_m_w    ] o.a.s.h.a.PrepRecoveryOp Waited coreNodeName: core_node46, state: recovering, checkLive: true, onlyIfLeader: true for: 1 seconds.
   [junit4]   2> 210710 INFO  (qtp29713451-2101) [n:127.0.0.1:36769_m_w    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={nodeName=127.0.0.1:37479_m_w&onlyIfLeaderActive=true&core=collection1_shard2_replica_t41&coreNodeName=core_node46&action=PREPRECOVERY&checkLive=true&state=recovering&onlyIfLeader=true&wt=javabin&version=2} status=0 QTime=1000
   [junit4]   2> 211211 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Starting Replication Recovery.
   [junit4]   2> 211211 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Attempting to replicate from [http://127.0.0.1:36769/m_w/collection1_shard2_replica_t41/].
   [junit4]   2> 211212 INFO  (SocketProxy-Acceptor-36769) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38458,localport=36769], receiveBufferSize:531000
   [junit4]   2> 211213 INFO  (SocketProxy-Acceptor-36769) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35543,localport=50698], receiveBufferSize=530904
   [junit4]   2> 211217 INFO  (qtp29713451-2101) [n:127.0.0.1:36769_m_w c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1576367987941703680,optimize=false,openSearcher=false,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 211217 INFO  (qtp29713451-2101) [n:127.0.0.1:36769_m_w c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
   [junit4]   2> 211218 INFO  (qtp29713451-2101) [n:127.0.0.1:36769_m_w c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 211218 INFO  (qtp29713451-2101) [n:127.0.0.1:36769_m_w c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_t41]  webapp=/m_w path=/update params={waitSearcher=true&openSearcher=false&commit=true&softCommit=false&commit_end_point=true&wt=javabin&version=2}{commit=} 0 1
   [junit4]   2> 211219 INFO  (SocketProxy-Acceptor-36769) [    ] o.a.s.c.SocketProxy accepted Socket[addr=/127.0.0.1,port=38462,localport=36769], receiveBufferSize:531000
   [junit4]   2> 211220 INFO  (SocketProxy-Acceptor-36769) [    ] o.a.s.c.SocketProxy proxy connection Socket[addr=/127.0.0.1,port=35543,localport=50702], receiveBufferSize=530904
   [junit4]   2> 211221 INFO  (qtp29713451-2099) [n:127.0.0.1:36769_m_w c:collection1 s:shard2 r:core_node42 x:collection1_shard2_replica_t41] o.a.s.c.S.Request [collection1_shard2_replica_t41]  webapp=/m_w path=/replication params={qt=/replication&wt=javabin&version=2&command=indexversion} status=0 QTime=0
   [junit4]   2> 211222 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Master's generation: 1
   [junit4]   2> 211222 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Master's version: 0
   [junit4]   2> 211222 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Slave's generation: 1
   [junit4]   2> 211222 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Slave's version: 0
   [junit4]   2> 211222 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Replication Recovery was successful.
   [junit4]   2> 211222 INFO  (recoveryExecutor-333-thread-1-processing-n:127.0.0.1:37479_m_w x:collection1_shard2_replica_t45 s:shard2 c:collection1 r:core_node46) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.c.RecoveryStrategy Registeri

[...truncated too long message...]

.1:37479_m_w-n_0000000003) [n:127.0.0.1:37479_m_w    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37479_m_w
   [junit4]   2> 231726 WARN  (zkCallback-335-thread-3-processing-n:127.0.0.1:37479_m_w) [n:127.0.0.1:37479_m_w    ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
   [junit4]   2> 231726 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@f9c99d{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 231727 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@a6f516{/m_w,null,UNAVAILABLE}
   [junit4]   2> 231727 ERROR (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 231727 INFO  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44917 44917
   [junit4]   2> 231728 WARN  (indexFetcher-1165-thread-1) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.IndexFetcher Could not log failed replication details
   [junit4]   2> org.apache.lucene.store.AlreadyClosedException: Already closed
   [junit4]   2> 	at org.apache.solr.core.CachingDirectoryFactory.get(CachingDirectoryFactory.java:337)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.loadReplicationProperties(ReplicationHandler.java:1131)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.logReplicationTimeAndConfFiles(IndexFetcher.java:769)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.cleanup(IndexFetcher.java:677)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:659)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:332)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:419)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(ReplicationHandler.java:1183)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 231728 ERROR (indexFetcher-1165-thread-1) [n:127.0.0.1:37479_m_w c:collection1 s:shard2 r:core_node46 x:collection1_shard2_replica_t45] o.a.s.h.ReplicationHandler Index fetch failed :org.apache.solr.common.SolrException: No registered leader was found after waiting for 4000ms , collection: collection1 slice: shard2
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:758)
   [junit4]   2> 	at org.apache.solr.common.cloud.ZkStateReader.getLeaderRetry(ZkStateReader.java:744)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.getLeaderReplica(IndexFetcher.java:667)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:367)
   [junit4]   2> 	at org.apache.solr.handler.IndexFetcher.fetchLatestIndex(IndexFetcher.java:332)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.doFetch(ReplicationHandler.java:419)
   [junit4]   2> 	at org.apache.solr.handler.ReplicationHandler.lambda$setupPolling$12(ReplicationHandler.java:1183)
   [junit4]   2> 	at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
   [junit4]   2> 	at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
   [junit4]   2> 	at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
   [junit4]   2> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 
   [junit4]   2> 231760 INFO  (Thread-537) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:44917 44917
   [junit4]   2> 231760 WARN  (Thread-537) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/aliases.json
   [junit4]   2> 	4	/solr/security.json
   [junit4]   2> 	4	/solr/configs/conf1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/clusterprops.json
   [junit4]   2> 	6	/solr/clusterstate.json
   [junit4]   2> 	3	/solr/collections/collection1/state.json
   [junit4]   2> 	3	/solr/collections/collMinRf_1x3/state.json
   [junit4]   2> 	2	/solr/collections/c8n_crud_1x2/state.json
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	6	/solr/live_nodes
   [junit4]   2> 	6	/solr/collections
   [junit4]   2> 	4	/solr/overseer/queue
   [junit4]   2> 	4	/solr/overseer/collection-queue-work
   [junit4]   2> 
   [junit4]   2> 231761 WARN  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SocketProxy Closing 12 connections to: http://127.0.0.1:36769/m_w, target: http://127.0.0.1:35543/m_w
   [junit4]   2> 231761 WARN  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SocketProxy Closing 3 connections to: http://127.0.0.1:37479/m_w, target: http://127.0.0.1:40925/m_w
   [junit4]   2> 231761 WARN  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SocketProxy Closing 9 connections to: http://127.0.0.1:33981/m_w, target: http://127.0.0.1:36377/m_w
   [junit4]   2> 231761 WARN  (TEST-HttpPartitionTest.test-seed#[D31F5E8D9AE0F05]) [    ] o.a.s.c.SocketProxy Closing 2 connections to: http://127.0.0.1:46785/m_w, target: http://127.0.0.1:45365/m_w
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=HttpPartitionTest -Dtests.method=test -Dtests.seed=D31F5E8D9AE0F05 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=ko -Dtests.timezone=HST -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
   [junit4] FAILURE 29.2s J2 | HttpPartitionTest.test <<<
   [junit4]    > Throwable #1: java.lang.AssertionError: Doc with id=1 not found in http://127.0.0.1:36769/m_w/collMinRf_1x3 due to: Path not found: /id; rsp={doc=null}
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([D31F5E8D9AE0F05:8565CA32775262FD]:0)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocExists(HttpPartitionTest.java:603)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.assertDocsExistInAllReplicas(HttpPartitionTest.java:558)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.testMinRf(HttpPartitionTest.java:249)
   [junit4]    > 	at org.apache.solr.cloud.HttpPartitionTest.test(HttpPartitionTest.java:127)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /home/jenkins/workspace/Lucene-Solr-master-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.HttpPartitionTest_D31F5E8D9AE0F05-001
   [junit4]   2> Aug 21, 2017 6:54:43 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> NOTE: test params are: codec=CheapBastard, sim=RandomSimilarity(queryNorm=true): {}, locale=ko, timezone=HST
   [junit4]   2> NOTE: Linux 4.10.0-27-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=114041776,total=308019200
   [junit4]   2> NOTE: All tests run in this JVM: [TestHalfAndHalfDocValues, TestNumericTokenStream, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestSuggestSpellingConverter, TestGroupingSearch, TestDFRSimilarityFactory, TestTrackingShardHandlerFactory, OverseerCollectionConfigSetProcessorTest, TestChildDocTransformer, WrapperMergePolicyFactoryTest, PrimitiveFieldTypeTest, DistributedSuggestComponentTest, UniqFieldsUpdateProcessorFactoryTest, TestAnalyzedSuggestions, TestMultiValuedNumericRangeQuery, LeaderFailureAfterFreshStartTest, TestStressReorder, TestSurroundQueryParser, SimpleFacetsTest, GraphQueryTest, DirectUpdateHandlerTest, ResponseHeaderTest, TestQuerySenderListener, TestConfigSetProperties, AsyncCallRequestStatusResponseTest, TestFreeTextSuggestions, TestCodecSupport, StatsReloadRaceTest, TestSchemalessBufferedUpdates, AliasIntegrationTest, TestFoldingMultitermQuery, JSONWriterTest, TestManagedStopFilterFactory, HardAutoCommitTest, BlockDirectoryTest, DistributedExpandComponentTest, TestUnifiedSolrHighlighter, TestExactSharedStatsCache, MinimalSchemaTest, TestCustomStream, QueryEqualityTest, HdfsSyncSliceTest, CdcrReplicationDistributedZkTest, SignatureUpdateProcessorFactoryTest, DeleteStatusTest, TestTrieFacet, HttpPartitionTest]
   [junit4] Completed [81/730 (1!)] on J2 in 29.48s, 1 test, 1 failure <<< FAILURES!

[...truncated 41567 lines...]