You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/02/28 06:00:08 UTC

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1703 - Still unstable!

Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1703/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseSerialGC

2 tests failed.
FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation

Error Message:
4 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:     1) Thread[id=18315, name=jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    2) Thread[id=18316, name=jetty-launcher-2990-thread-1-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)    3) Thread[id=18317, name=jetty-launcher-2990-thread-2-SendThread(127.0.0.1:54645), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    4) Thread[id=18318, name=jetty-launcher-2990-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at sun.misc.Unsafe.park(Native Method)         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   1) Thread[id=18315, name=jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   2) Thread[id=18316, name=jetty-launcher-2990-thread-1-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   3) Thread[id=18317, name=jetty-launcher-2990-thread-2-SendThread(127.0.0.1:54645), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   4) Thread[id=18318, name=jetty-launcher-2990-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at sun.misc.Unsafe.park(Native Method)
        at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
        at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
        at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
	at __randomizedtesting.SeedInfo.seed([391702F176416E7D]:0)


FAILED:  junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation

Error Message:
There are still zombie threads that couldn't be terminated:    1) Thread[id=18315, name=jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)    2) Thread[id=18317, name=jetty-launcher-2990-thread-2-SendThread(127.0.0.1:54645), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]         at java.lang.Thread.sleep(Native Method)         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)

Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   1) Thread[id=18315, name=jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   2) Thread[id=18317, name=jetty-launcher-2990-thread-2-SendThread(127.0.0.1:54645), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
        at java.lang.Thread.sleep(Native Method)
        at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
        at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
        at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
	at __randomizedtesting.SeedInfo.seed([391702F176416E7D]:0)




Build Log:
[...truncated 13053 lines...]
   [junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_391702F176416E7D-001/init-core-data-001
   [junit4]   2> 1726683 WARN  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[391702F176416E7D]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
   [junit4]   2> 1726687 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[391702F176416E7D]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 1726689 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[391702F176416E7D]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN)
   [junit4]   2> 1726689 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[391702F176416E7D]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 1726729 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[391702F176416E7D]-worker) [    ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_391702F176416E7D-001/tempDir-001
   [junit4]   2> 1726729 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[391702F176416E7D]-worker) [    ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
   [junit4]   2> 1726730 INFO  (Thread-6452) [    ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
   [junit4]   2> 1726730 INFO  (Thread-6452) [    ] o.a.s.c.ZkTestServer Starting server
   [junit4]   2> 1726732 ERROR (Thread-6452) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1726830 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[391702F176416E7D]-worker) [    ] o.a.s.c.ZkTestServer start zk server on port:54645
   [junit4]   2> 1726833 INFO  (zkConnectionManagerCallback-2993-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1726839 INFO  (jetty-launcher-2990-thread-1) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1726839 INFO  (jetty-launcher-2990-thread-2) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T18:27:37-03:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 1726840 INFO  (jetty-launcher-2990-thread-1) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1726840 INFO  (jetty-launcher-2990-thread-1) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1726840 INFO  (jetty-launcher-2990-thread-1) [    ] o.e.j.s.session Scavenging every 600000ms
   [junit4]   2> 1726840 INFO  (jetty-launcher-2990-thread-1) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@179e62e{/solr,null,AVAILABLE}
   [junit4]   2> 1726842 INFO  (jetty-launcher-2990-thread-1) [    ] o.e.j.s.AbstractConnector Started ServerConnector@d778ae2{HTTP/1.1,[http/1.1]}{127.0.0.1:60281}
   [junit4]   2> 1726842 INFO  (jetty-launcher-2990-thread-1) [    ] o.e.j.s.Server Started @1730102ms
   [junit4]   2> 1726842 INFO  (jetty-launcher-2990-thread-1) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60281}
   [junit4]   2> 1726842 ERROR (jetty-launcher-2990-thread-1) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1726842 INFO  (jetty-launcher-2990-thread-1) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 1726842 INFO  (jetty-launcher-2990-thread-1) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1726842 INFO  (jetty-launcher-2990-thread-1) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1726842 INFO  (jetty-launcher-2990-thread-1) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-28T05:20:20.059Z
   [junit4]   2> 1726845 INFO  (jetty-launcher-2990-thread-2) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 1726845 INFO  (jetty-launcher-2990-thread-2) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 1726845 INFO  (jetty-launcher-2990-thread-2) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 1726845 INFO  (jetty-launcher-2990-thread-2) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4c295778{/solr,null,AVAILABLE}
   [junit4]   2> 1726845 INFO  (jetty-launcher-2990-thread-2) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7cc98c50{HTTP/1.1,[http/1.1]}{127.0.0.1:45267}
   [junit4]   2> 1726845 INFO  (jetty-launcher-2990-thread-2) [    ] o.e.j.s.Server Started @1730106ms
   [junit4]   2> 1726845 INFO  (jetty-launcher-2990-thread-2) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=45267}
   [junit4]   2> 1726845 INFO  (zkConnectionManagerCallback-2995-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1726846 ERROR (jetty-launcher-2990-thread-2) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 1726846 INFO  (jetty-launcher-2990-thread-2) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 1726846 INFO  (jetty-launcher-2990-thread-2) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in cloud mode on port null
   [junit4]   2> 1726846 INFO  (jetty-launcher-2990-thread-2) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 1726846 INFO  (jetty-launcher-2990-thread-2) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-28T05:20:20.063Z
   [junit4]   2> 1726847 INFO  (jetty-launcher-2990-thread-1) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1726848 INFO  (zkConnectionManagerCallback-2997-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1726849 INFO  (jetty-launcher-2990-thread-2) [    ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
   [junit4]   2> 1726855 INFO  (jetty-launcher-2990-thread-1) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54645/solr
   [junit4]   2> 1726856 INFO  (jetty-launcher-2990-thread-2) [    ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:54645/solr
   [junit4]   2> 1726856 INFO  (zkConnectionManagerCallback-3002-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1726858 INFO  (zkConnectionManagerCallback-3005-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1726874 INFO  (zkConnectionManagerCallback-3007-thread-1-processing-n:127.0.0.1:60281_solr) [n:127.0.0.1:60281_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1726874 INFO  (zkConnectionManagerCallback-3009-thread-1-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1727120 INFO  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1727121 INFO  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:45267_solr
   [junit4]   2> 1727123 INFO  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.c.Overseer Overseer (id=72274601070034950-127.0.0.1:45267_solr-n_0000000000) starting
   [junit4]   2> 1727134 INFO  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:45267_solr
   [junit4]   2> 1727149 INFO  (jetty-launcher-2990-thread-1) [n:127.0.0.1:60281_solr    ] o.a.s.c.Overseer Overseer (id=null) closing
   [junit4]   2> 1727151 INFO  (OverseerStateUpdate-72274601070034950-127.0.0.1:45267_solr-n_0000000000) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1727154 INFO  (zkCallback-3006-thread-1-processing-n:127.0.0.1:60281_solr) [n:127.0.0.1:60281_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
   [junit4]   2> 1727157 INFO  (jetty-launcher-2990-thread-1) [n:127.0.0.1:60281_solr    ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60281_solr
   [junit4]   2> 1727159 INFO  (zkCallback-3008-thread-1-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1727161 INFO  (zkCallback-3006-thread-1-processing-n:127.0.0.1:60281_solr) [n:127.0.0.1:60281_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
   [junit4]   2> 1727213 INFO  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 1727228 INFO  (jetty-launcher-2990-thread-1) [n:127.0.0.1:60281_solr    ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
   [junit4]   2> 1727240 WARN  (jetty-launcher-2990-thread-1) [n:127.0.0.1:60281_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 1727241 WARN  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 1727253 INFO  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
   [junit4]   2> 1727253 INFO  (jetty-launcher-2990-thread-1) [n:127.0.0.1:60281_solr    ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=serv1-vm3,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=staff, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
   [junit4]   2> 1727378 INFO  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 1727432 INFO  (jetty-launcher-2990-thread-2-EventThread) [n:127.0.0.1:45267_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 1727436 INFO  (jetty-launcher-2990-thread-1) [n:127.0.0.1:60281_solr    ] o.a.c.f.i.CuratorFrameworkImpl Starting
   [junit4]   2> 1727456 INFO  (jetty-launcher-2990-thread-1-EventThread) [n:127.0.0.1:60281_solr    ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
   [junit4]   2> 1727680 WARN  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 1727723 WARN  (jetty-launcher-2990-thread-1) [n:127.0.0.1:60281_solr    ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
   [junit4]   2> 1727739 INFO  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45267.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34fb807f
   [junit4]   2> 1727747 INFO  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45267.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34fb807f
   [junit4]   2> 1727747 INFO  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45267.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34fb807f
   [junit4]   2> 1727748 INFO  (jetty-launcher-2990-thread-2) [n:127.0.0.1:45267_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_391702F176416E7D-001/tempDir-001/node1/.
   [junit4]   2> 1727776 INFO  (jetty-launcher-2990-thread-1) [n:127.0.0.1:60281_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60281.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34fb807f
   [junit4]   2> 1727789 INFO  (jetty-launcher-2990-thread-1) [n:127.0.0.1:60281_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60281.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34fb807f
   [junit4]   2> 1727789 INFO  (jetty-launcher-2990-thread-1) [n:127.0.0.1:60281_solr    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_60281.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34fb807f
   [junit4]   2> 1727791 INFO  (jetty-launcher-2990-thread-1) [n:127.0.0.1:60281_solr    ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_391702F176416E7D-001/tempDir-001/node2/.
   [junit4]   2> 1727815 INFO  (zkConnectionManagerCallback-3015-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1727877 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
   [junit4]   2> 1727940 WARN  (qtp1394037262-18203) [    ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: invalid user name: "bar"
   [junit4]   2> id: invalid user name: "bar"
   [junit4]   2> 
   [junit4]   2> 1727960 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=test&e=1519831221116&s=84G/Mz8uEOh+Ptc8+HRARgQPu8o="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:21 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:21 GMT
   [junit4]   2> 1727960 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
   [junit4]   2> 1728002 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
   [junit4]   2> 1728010 INFO  (qtp1394037262-18209) [n:127.0.0.1:45267_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1728011 INFO  (qtp1394037262-18209) [n:127.0.0.1:45267_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1728011 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=test&e=1519831221220&s=m7vDkySg0KhO478D5w9BhJqKXDA="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:21 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:21 GMT
   [junit4]   2> 1728012 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
   [junit4]   2> 1728055 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
   [junit4]   2> 1728056 INFO  (qtp1394037262-18211) [    ] o.a.s.s.SolrDispatchFilter Error authenticating
   [junit4]   2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:458)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:353)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:330)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:530)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> 1728057 WARN  (qtp1394037262-18211) [    ] o.e.j.s.HttpChannel /solr/admin/collections
   [junit4]   2> org.apache.solr.common.SolrException: Error during request authentication, 
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:464)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:353)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:330)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
   [junit4]   2> 	at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
   [junit4]   2> 	at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
   [junit4]   2> 	at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
   [junit4]   2> 	at org.eclipse.jetty.server.Server.handle(Server.java:530)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
   [junit4]   2> 	at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
   [junit4]   2> 	at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
   [junit4]   2> 	at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
   [junit4]   2> 	at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]   2> 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]   2> 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
   [junit4]   2> 	at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
   [junit4]   2> 	at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
   [junit4]   2> 	at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
   [junit4]   2> 	at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
   [junit4]   2> 	at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
   [junit4]   2> 	at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
   [junit4]   2> 	at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:458)
   [junit4]   2> 	... 31 more
   [junit4]   2> 1728059 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
   [junit4]   2> 1728103 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
   [junit4]   2> 1728158 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=test&e=1519831221321&s=te7rhl5fS8a0GZXZuy9AHSrclLo="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:21 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:21 GMT
   [junit4]   2> 1728158 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
   [junit4]   2> 1728219 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
   [junit4]   2> 1728240 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1519831221437&s=yLSqnkQTNuEttJUaeJYHtbSkwZU="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:21 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:21 GMT
   [junit4]   2> 1728240 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
   [junit4]   2> 1728275 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
   [junit4]   2> 1728326 INFO  (zkConnectionManagerCallback-3018-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1729239 INFO  (zkConnectionManagerCallback-3021-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1729243 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[391702F176416E7D]) [    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
   [junit4]   2> 1729245 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[391702F176416E7D]) [    ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:54645/solr ready
   [junit4]   2> 1729250 INFO  (qtp2005134345-18193) [n:127.0.0.1:60281_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1729265 INFO  (OverseerThreadFactory-5964-thread-1-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.a.c.CreateCollectionCmd Create collection forwardingCollection
   [junit4]   2> 1729389 INFO  (OverseerStateUpdate-72274601070034950-127.0.0.1:45267_solr-n_0000000000) [n:127.0.0.1:45267_solr    ] o.a.s.c.o.SliceMutator createReplica() {
   [junit4]   2>   "operation":"ADDREPLICA",
   [junit4]   2>   "collection":"forwardingCollection",
   [junit4]   2>   "shard":"shard1",
   [junit4]   2>   "core":"forwardingCollection_shard1_replica_n1",
   [junit4]   2>   "state":"down",
   [junit4]   2>   "base_url":"http://127.0.0.1:45267/solr",
   [junit4]   2>   "type":"NRT",
   [junit4]   2>   "waitForFinalState":"false"} 
   [junit4]   2> 1729595 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr    ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
   [junit4]   2> 1729596 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1729707 INFO  (zkCallback-3008-thread-1-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1729708 INFO  (zkCallback-3008-thread-2-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1730631 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 1730676 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
   [junit4]   2> 1730833 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 1730867 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
   [junit4]   2> 1730880 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_45267.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@34fb807f
   [junit4]   2> 1730881 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 1730881 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_391702F176416E7D-001/tempDir-001/node1/forwardingCollection_shard1_replica_n1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_391702F176416E7D-001/tempDir-001/node1/./forwardingCollection_shard1_replica_n1/data/]
   [junit4]   2> 1730885 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=44, maxMergeAtOnceExplicit=14, maxMergedSegmentMB=58.4580078125, floorSegmentMB=1.58203125, forceMergeDeletesPctAllowed=22.652097790076006, segmentsPerTier=21.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
   [junit4]   2> 1730985 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 1730985 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 1730986 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 1730986 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 1730988 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=49, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 1730988 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@17dda405[forwardingCollection_shard1_replica_n1] main]
   [junit4]   2> 1730998 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 1731003 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 1731078 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 1731078 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593620797110353920
   [junit4]   2> 1731088 INFO  (searcherExecutor-5969-thread-1-processing-n:127.0.0.1:45267_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 1731092 INFO  (searcherExecutor-5969-thread-1-processing-n:127.0.0.1:45267_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 1731092 INFO  (searcherExecutor-5969-thread-1-processing-n:127.0.0.1:45267_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 1731092 INFO  (searcherExecutor-5969-thread-1-processing-n:127.0.0.1:45267_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 1731093 INFO  (searcherExecutor-5969-thread-1-processing-n:127.0.0.1:45267_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 1731094 INFO  (searcherExecutor-5969-thread-1-processing-n:127.0.0.1:45267_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 1731094 INFO  (searcherExecutor-5969-thread-1-processing-n:127.0.0.1:45267_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 1731094 INFO  (searcherExecutor-5969-thread-1-processing-n:127.0.0.1:45267_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 1731095 INFO  (searcherExecutor-5969-thread-1-processing-n:127.0.0.1:45267_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 1731095 INFO  (searcherExecutor-5969-thread-1-processing-n:127.0.0.1:45267_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@17dda405[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 1731097 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
   [junit4]   2> 1731097 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
   [junit4]   2> 1731097 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:45267/solr/forwardingCollection_shard1_replica_n1/
   [junit4]   2> 1731097 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
   [junit4]   2> 1731097 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:45267/solr/forwardingCollection_shard1_replica_n1/ has no replicas
   [junit4]   2> 1731097 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
   [junit4]   2> 1731108 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:45267/solr/forwardingCollection_shard1_replica_n1/ shard1
   [junit4]   2> 1731211 INFO  (zkCallback-3008-thread-1-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1731211 INFO  (zkCallback-3008-thread-2-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1731261 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
   [junit4]   2> 1731264 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1670
   [junit4]   2> 1731265 WARN  (httpShardExecutor-5960-thread-1-processing-n:127.0.0.1:45267_solr [http:////127.0.0.1:45267//solr] http:////127.0.0.1:45267//solr) [n:127.0.0.1:45267_solr    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1519831222811&s=GUDxTuTP5UVwHAYkPUwODnmje5w="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:22 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:22 GMT
   [junit4]   2> 1731276 INFO  (qtp2005134345-18193) [n:127.0.0.1:60281_solr    ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
   [junit4]   2> 1731377 INFO  (zkCallback-3008-thread-3-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1731378 INFO  (zkCallback-3008-thread-1-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
   [junit4]   2> 1732293 INFO  (qtp2005134345-18193) [n:127.0.0.1:60281_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3044
   [junit4]   2> 1732300 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1519831222466&s=nugpf0kBb7pEOUHHw5Rb7n9evrc="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:22 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:22 GMT
   [junit4]   2> 1732301 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[391702F176416E7D]) [    ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
   [junit4]   2> 1732302 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[391702F176416E7D]) [    ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
   [junit4]   2> 1732317 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1732318 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1519831225529&s=PqUQpyTpt2gCucl3f8jh0QJK9BQ="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:25 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:25 GMT
   [junit4]   2> 1732323 INFO  (qtp2005134345-18194) [n:127.0.0.1:60281_solr    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 1732327 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1]  webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
   [junit4]   2> 1732327 WARN  (qtp2005134345-18194) [n:127.0.0.1:60281_solr    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1519831225543&s=LuskeDn3PjuX5qm3B4MjQSTIhXE="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:25 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:25 GMT
   [junit4]   2> 1732328 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1519831225538&s=zmTDrvMr408HHP/828RLqMpoEmA="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:25 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:25 GMT
   [junit4]   2> 1732328 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1519831225543&s=LuskeDn3PjuX5qm3B4MjQSTIhXE="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:25 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:25 GMT
   [junit4]   2> 1732329 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
   [junit4]   2> 1732375 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
   [junit4]   2> 1732380 INFO  (qtp1394037262-18209) [n:127.0.0.1:45267_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1732380 INFO  (qtp1394037262-18209) [n:127.0.0.1:45267_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1732381 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1519831225597&s=5I5GT72JPq/OnyBLSBei6hCh+WE="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:25 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:25 GMT
   [junit4]   2> 1732381 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
   [junit4]   2> 1732459 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
   [junit4]   2> 1732461 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=test&e=1519831225677&s=OTAbM76B+/PqsjGozwazUNwZEVI="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:25 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:25 GMT
   [junit4]   2> 1732462 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
   [junit4]   2> 1732509 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
   [junit4]   2> 1748326 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 16007ms for sessionid 0x100c55de3100005
   [junit4]   2> 1748327 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100c55de3100005, likely client has closed socket
   [junit4]   2> 1748327 WARN  (jetty-launcher-2990-thread-2-SendThread(127.0.0.1:54645)) [n:127.0.0.1:45267_solr    ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 16950ms for sessionid 0x100c55de3100006
   [junit4]   2> 1748327 WARN  (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [    ] o.a.z.s.NIOServerCnxn Unable to read additional data from client sessionid 0x100c55de3100006, likely client has closed socket
   [junit4]   2> 1748327 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1519831225726&s=/WVW5bT4KWJkQE0MViSkWN60I+8="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:25 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:25 GMT
   [junit4]   2> 1748327 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
   [junit4]   2> 1748363 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
   [junit4]   2> 1748392 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr    ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
   [junit4]   2> 1748392 INFO  (qtp1394037262-18211) [n:127.0.0.1:45267_solr    ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 1748393 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=test&e=1519831241580&s=pGGTAAbGYxxQAHs2pjkaE/u8tn8="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:41 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:41 GMT
   [junit4]   2> 1748393 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
   [junit4]   2> 1748422 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
   [junit4]   2> 1748423 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=test&e=1519831241640&s=aBMNtMARb37Tito8mF5Tm3U5vEA="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:41 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:41 GMT
   [junit4]   2> 1748423 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
   [junit4]   2> 1748429 INFO  (jetty-launcher-2990-thread-1-EventThread) [n:127.0.0.1:60281_solr    ] o.a.c.f.s.ConnectionStateManager State change: SUSPENDED
   [junit4]   2> 1748432 WARN  (zkConnectionManagerCallback-3021-thread-1) [    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@427e862c name: ZooKeeperConnection Watcher:127.0.0.1:54645/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 1748432 WARN  (zkConnectionManagerCallback-3021-thread-1) [    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 1748430 WARN  (zkConnectionManagerCallback-3009-thread-1-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@232fd5c2 name: ZooKeeperConnection Watcher:127.0.0.1:54645/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 1748433 WARN  (zkConnectionManagerCallback-3009-thread-1-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 1748434 WARN  (zkConnectionManagerCallback-3007-thread-1-processing-n:127.0.0.1:60281_solr) [n:127.0.0.1:60281_solr    ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@11747a1a name: ZooKeeperConnection Watcher:127.0.0.1:54645/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
   [junit4]   2> 1748434 WARN  (zkConnectionManagerCallback-3007-thread-1-processing-n:127.0.0.1:60281_solr) [n:127.0.0.1:60281_solr    ] o.a.s.c.c.ConnectionManager zkClient has disconnected
   [junit4]   2> 1748474 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
   [junit4]   2> 1748476 WARN  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[391702F176416E7D]) [    ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=test&e=1519831241691&s=pzQeF4bgfP6FvYD31a5kycfCV5Y="; Path=/; Domain=127.0.0.1; Expires= , 28-   -2018 15:20:41 GMT; HttpOnly". Invalid 'expires' attribute: , 28- -2018 15:20:41 GMT
   [junit4]   2> 1748477 INFO  (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[391702F176416E7D]) [    ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
   [junit4]   2> 1749373 INFO  (jetty-closer-2991-thread-2) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@d778ae2{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1749373 INFO  (jetty-closer-2991-thread-1) [    ] o.e.j.s.AbstractConnector Stopped ServerConnector@7cc98c50{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
   [junit4]   2> 1749374 INFO  (jetty-closer-2991-thread-2) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2107534713
   [junit4]   2> 1749374 INFO  (jetty-closer-2991-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1749375 INFO  (jetty-closer-2991-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@28e8400a: rootName = solr_60281, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1fb07abd
   [junit4]   2> 1749374 INFO  (jetty-closer-2991-thread-1) [    ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1376216581
   [junit4]   2> 1749379 INFO  (jetty-closer-2991-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
   [junit4]   2> 1749379 INFO  (jetty-closer-2991-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@143bef02: rootName = solr_45267, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@4c609d65
   [junit4]   2> 1749383 INFO  (jetty-closer-2991-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1749384 INFO  (jetty-closer-2991-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@991abe7: rootName = solr_60281, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@f213938
   [junit4]   2> 1749387 INFO  (jetty-closer-2991-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
   [junit4]   2> 1749387 INFO  (jetty-closer-2991-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@3819857c: rootName = solr_45267, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@f213938
   [junit4]   2> 1749389 INFO  (jetty-closer-2991-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1749389 INFO  (jetty-closer-2991-thread-2) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@422070bc: rootName = solr_60281, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@a21f717
   [junit4]   2> 1749392 INFO  (jetty-closer-2991-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
   [junit4]   2> 1749392 INFO  (jetty-closer-2991-thread-1) [    ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@669b9edd: rootName = solr_45267, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@a21f717
   [junit4]   2> 1749729 WARN  (jetty-launcher-2990-thread-2-SendThread(127.0.0.1:54645)) [n:127.0.0.1:45267_solr    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100c55de3100007 has expired
   [junit4]   2> 1749828 INFO  (zkConnectionManagerCallback-3009-thread-1-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1749835 INFO  (jetty-closer-2991-thread-1) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:45267_solr
   [junit4]   2> 1749836 INFO  (jetty-closer-2991-thread-1) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1749837 INFO  (zkCallback-3008-thread-3-processing-n:127.0.0.1:45267_solr) [n:127.0.0.1:45267_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1749837 INFO  (coreCloseExecutor-5974-thread-1) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1]  CLOSING SolrCore org.apache.solr.core.SolrCore@62fa5f4d
   [junit4]   2> 1749837 INFO  (coreCloseExecutor-5974-thread-1) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=1660575565
   [junit4]   2> 1749837 INFO  (coreCloseExecutor-5974-thread-1) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7979150c: rootName = solr_45267, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@7190cc9f
   [junit4]   2> 1749858 INFO  (coreCloseExecutor-5974-thread-1) [n:127.0.0.1:45267_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=1660575565
   [junit4]   2> 1749860 INFO  (jetty-closer-2991-thread-1) [    ] o.a.s.c.Overseer Overseer (id=72274601070034950-127.0.0.1:45267_solr-n_0000000000) closing
   [junit4]   2> 1749861 INFO  (OverseerStateUpdate-72274601070034950-127.0.0.1:45267_solr-n_0000000000) [n:127.0.0.1:45267_solr    ] o.a.s.c.Overseer According to ZK I (id=72274601070034950-127.0.0.1:45267_solr-n_0000000000) am no longer a leader.
   [junit4]   2> 1749861 INFO  (OverseerStateUpdate-72274601070034950-127.0.0.1:45267_solr-n_0000000000) [n:127.0.0.1:45267_solr    ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:45267_solr
   [junit4]   2> 1749861 INFO  (OverseerCollectionConfigSetProcessor-72274601070034950-127.0.0.1:45267_solr-n_0000000000) [n:127.0.0.1:45267_solr    ] o.a.s.c.OverseerTaskProcessor According to ZK I (id=72274601070034950-127.0.0.1:45267_solr-n_0000000000) am no longer a leader.
   [junit4]   2> 1749863 WARN  (OverseerAutoScalingTriggerThread-72274601070034950-127.0.0.1:45267_solr-n_0000000000) [n:127.0.0.1:45267_solr    ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
   [junit4]   2> 1749867 ERROR (Thread[Thread-6472,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:45267_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 1749876 INFO  (jetty-closer-2991-thread-1) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@4c295778{/solr,null,UNAVAILABLE}
   [junit4]   2> 1749877 INFO  (jetty-closer-2991-thread-1) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 1750089 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100c55de3100008 has expired
   [junit4]   2> 1750410 INFO  (zkConnectionManagerCallback-3007-thread-1-processing-n:127.0.0.1:60281_solr) [n:127.0.0.1:60281_solr    ] o.a.s.c.c.ConnectionManager zkClient has connected
   [junit4]   2> 1750411 INFO  (zkCallback-3006-thread-4-processing-n:127.0.0.1:60281_solr) [n:127.0.0.1:60281_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
   [junit4]   2> 1750411 INFO  (zkCallback-3006-thread-6-processing-n:127.0.0.1:60281_solr) [n:127.0.0.1:60281_solr    ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60281_solr
   [junit4]   2> 1750412 INFO  (jetty-closer-2991-thread-2) [    ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:60281_solr
   [junit4]   2> 1750413 INFO  (jetty-closer-2991-thread-2) [    ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
   [junit4]   2> 1750414 INFO  (zkCallback-3006-thread-4-processing-n:127.0.0.1:60281_solr) [n:127.0.0.1:60281_solr    ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
   [junit4]   2> 1750415 ERROR (Thread[Thread-6474,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:60281_solr    ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 1750419 INFO  (jetty-closer-2991-thread-2) [    ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@179e62e{/solr,null,UNAVAILABLE}
   [junit4]   2> 1750420 INFO  (jetty-closer-2991-thread-2) [    ] o.e.j.s.session Stopped scavenging
   [junit4]   2> 1750422 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[391702F176416E7D]-worker) [    ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
   [junit4]   2> 1750422 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[391702F176416E7D]-worker) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:54645 54645
   [junit4]   2> 1760662 INFO  (Thread-6452) [    ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:54645 54645
   [junit4]   2> 1760664 WARN  (Thread-6452) [    ] o.a.s.c.ZkTestServer Watch limit violations: 
   [junit4]   2> Maximum concurrent create/delete watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/aliases.json
   [junit4]   2> 	3	/solr/clusterprops.json
   [junit4]   2> 	2	/solr/security.json
   [junit4]   2> 	2	/solr/collections/forwardingCollection/terms/shard1
   [junit4]   2> 
   [junit4]   2> Maximum concurrent data watches above limit:
   [junit4]   2> 
   [junit4]   2> 	5	/solr/collections/forwardingCollection/state.json
   [junit4]   2> 	3	/solr/clusterstate.json
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
   [junit4]   2> 
   [junit4]   2> Maximum concurrent children watches above limit:
   [junit4]   2> 
   [junit4]   2> 	3	/solr/live_nodes
   [junit4]   2> 	3	/solr/collections
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
   [junit4]   2> 	2	/solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
   [junit4]   2> 
   [junit4]   2> 1760691 INFO  (SUITE-TestSolrCloudWithSecureImpersonation-seed#[391702F176416E7D]-worker) [    ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
   [junit4]   2> Feb 28, 2018 5:20:53 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
   [junit4]   2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
   [junit4]   2> 1778553 ERROR (jetty-launcher-2990-thread-1-EventThread) [n:127.0.0.1:60281_solr    ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
   [junit4]   2> java.lang.IllegalStateException: Client is not started
   [junit4]   2> 	at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
   [junit4]   2> 	at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:113)
   [junit4]   2> 	at org.apache.curator.framework.imps.CuratorFrameworkImpl.getZooKeeper(CuratorFrameworkImpl.java:477)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceFacade.getZooKeeper(NamespaceFacade.java:112)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:302)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:291)
   [junit4]   2> 	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   [junit4]   2> 1778554 WARN  (jetty-launcher-2990-thread-1-EventThread) [n:127.0.0.1:60281_solr    ] o.a.c.ConnectionState Session expired event received
   [junit4]   2> 1778556 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1779665 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1780768 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1781871 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1782982 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1784084 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1785185 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1786287 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1787391 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1788495 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1789597 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1790705 WARN  (jetty-launcher-2990-thread-1-SendThread(127.0.0.1:54645)) [n:127.0.0.1:60281_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 1790723 ERROR (jetty-launcher-2990-thread-2-EventThread) [n:127.0.0.1:45267_solr    ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
   [junit4]   2> java.lang.IllegalStateException: Client is not started
   [junit4]   2> 	at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
   [junit4]   2> 	at org.apache.curator.CuratorZookeeperClient.getZooKeeper(CuratorZookeeperClient.java:113)
   [junit4]   2> 	at org.apache.curator.framework.imps.CuratorFrameworkImpl.getZooKeeper(CuratorFrameworkImpl.java:477)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceFacade.getZooKeeper(NamespaceFacade.java:112)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:302)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl$4.call(GetDataBuilderImpl.java:291)
   [junit4]   2> 	at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:107)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
   [junit4]   2> 	at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
   [junit4]   2> 	at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
   [junit4]   2> 	at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:531)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506)
   [junit4]   2> 1790723 WARN  (jetty-launcher-2990-thread-2-EventThread) [

[...truncated too long message...]

.0.1:56737_solr    ] o.a.z.c.StaticHostProvider Unexpected exception
   [junit4]   2> java.lang.InterruptedException: sleep interrupted
   [junit4]   2> 	at java.lang.Thread.sleep(Native Method)
   [junit4]   2> 	at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   [junit4]   2> 133043 WARN  (jetty-launcher-1-thread-2-SendThread(127.0.0.1:56187)) [n:127.0.0.1:53975_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> 133043 WARN  (jetty-launcher-1-thread-1-SendThread(127.0.0.1:56187)) [n:127.0.0.1:56737_solr    ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
   [junit4]   2> java.net.ConnectException: Connection refused
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
   [junit4]   2> 	at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
   [junit4]   2> 	at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1144)
   [junit4]   2> Feb 28, 2018 5:54:51 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
   [junit4]   2> SEVERE: There are still zombie threads that couldn't be terminated:
   [junit4]   2>    1) Thread[id=168, name=jetty-launcher-1-thread-1-SendThread(127.0.0.1:56187), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   [junit4]   2>    2) Thread[id=166, name=jetty-launcher-1-thread-2-SendThread(127.0.0.1:56187), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]   2>         at java.lang.Thread.sleep(Native Method)
   [junit4]   2>         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
   [junit4]   2>         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1543, maxMBSortInHeap=5.152153550293639, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@70421c00), locale=ar-SD, timezone=Pacific/Pago_Pago
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=3,free=33330352,total=97583104
   [junit4]   2> NOTE: All tests run in this JVM: [TestSolrCloudWithSecureImpersonation]
   [junit4]   2> NOTE: reproduce with: ant test  -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=391702F176416E7D -Dtests.slow=true -Dtests.badapples=true -Dtests.locale=ar-SD -Dtests.timezone=Pacific/Pago_Pago -Dtests.asserts=true -Dtests.file.encoding=UTF-8
   [junit4] ERROR   0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
   [junit4]    > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 4 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 
   [junit4]    >    1) Thread[id=168, name=jetty-launcher-1-thread-1-SendThread(127.0.0.1:56187), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   [junit4]    >    2) Thread[id=166, name=jetty-launcher-1-thread-2-SendThread(127.0.0.1:56187), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   [junit4]    >    3) Thread[id=169, name=jetty-launcher-1-thread-1-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   [junit4]    >    4) Thread[id=167, name=jetty-launcher-1-thread-2-EventThread, state=WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at sun.misc.Unsafe.park(Native Method)
   [junit4]    >         at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
   [junit4]    >         at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
   [junit4]    >         at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:502)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([391702F176416E7D]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
   [junit4]    >    1) Thread[id=168, name=jetty-launcher-1-thread-1-SendThread(127.0.0.1:56187), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   [junit4]    >    2) Thread[id=166, name=jetty-launcher-1-thread-2-SendThread(127.0.0.1:56187), state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
   [junit4]    >         at java.lang.Thread.sleep(Native Method)
   [junit4]    >         at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:105)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:1000)
   [junit4]    >         at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1063)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([391702F176416E7D]:0)
   [junit4] Completed [3/5 (2!)] on J1 in 134.61s, 12 tests, 2 errors <<< FAILURES!

[...truncated 17 lines...]
BUILD FAILED
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1561: The following error occurred while executing this line:
/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/lucene/common-build.xml:1085: There were test failures: 5 suites, 60 tests, 4 suite-level errors, 36 ignored [seed: 391702F176416E7D]

Total time: 2 minutes 17 seconds

[repro] Setting last failure code to 256

[repro] Failures:
[repro]   2/5 failed: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[repro] Exiting with code 256
+ mv lucene/build lucene/build.repro
+ mv solr/build solr/build.repro
+ mv lucene/build.orig lucene/build
+ mv solr/build.orig solr/build
Archiving artifacts
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
[WARNINGS] Parsing warnings in console log with parser Java Compiler (javac)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
<Git Blamer> Using GitBlamer to create author and commit information for all warnings.
<Git Blamer> GIT_COMMIT=7dba350c7a02fe603faec49227ff2672e4d8e6ae, workspace=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris
[WARNINGS] Computing warning deltas based on reference build #1701
Recording test results
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Build step 'Publish JUnit test result report' changed build result to UNSTABLE
Email was triggered for: Unstable (Test Failures)
Sending email for trigger: Unstable (Test Failures)
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2

[JENKINS] Lucene-Solr-master-Solaris (64bit/jdk1.8.0) - Build # 1704 - Failure!

Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1704/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseConcMarkSweepGC

No tests ran.

Build Log:
[...truncated 13359 lines...]
   [junit4] Suite: org.apache.solr.TestDistributedSearch
   [junit4]   2> Creating dataDir: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001/init-core-data-001
   [junit4]   2> 2824176 WARN  (SUITE-TestDistributedSearch-seed#[21DE6392D67EB465]-worker) [    ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=381 numCloses=381
   [junit4]   2> 2824177 INFO  (SUITE-TestDistributedSearch-seed#[21DE6392D67EB465]-worker) [    ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
   [junit4]   2> 2824178 INFO  (SUITE-TestDistributedSearch-seed#[21DE6392D67EB465]-worker) [    ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-9061)
   [junit4]   2> 2824178 INFO  (SUITE-TestDistributedSearch-seed#[21DE6392D67EB465]-worker) [    ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
   [junit4]   2> 2824179 INFO  (SUITE-TestDistributedSearch-seed#[21DE6392D67EB465]-worker) [    ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
   [junit4]   2> 2824587 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001/tempDir-001/control/cores/collection1
   [junit4]   2> 2824589 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2824613 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2824613 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2824613 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2824613 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@49391fd8{/,null,AVAILABLE}
   [junit4]   2> 2824615 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@3e1ae821{HTTP/1.1,[http/1.1]}{127.0.0.1:49055}
   [junit4]   2> 2824615 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.Server Started @2828909ms
   [junit4]   2> 2824615 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=49055, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001/tempDir-001/control/cores}
   [junit4]   2> 2824615 ERROR (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2824616 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 2824616 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 2824616 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2824616 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-28T16:34:29.045Z
   [junit4]   2> 2824616 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001/tempDir-001/control/solr.xml
   [junit4]   2> 2824620 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 2824620 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2824621 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@260b2233, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2824681 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@260b2233
   [junit4]   2> 2824689 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@260b2233
   [junit4]   2> 2824690 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@260b2233
   [junit4]   2> 2824692 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001/tempDir-001/control/cores
   [junit4]   2> 2824692 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 2824725 INFO  (coreLoadExecutor-8426-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2824725 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2824804 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2824916 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 2825146 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2825188 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 2825189 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@260b2233
   [junit4]   2> 2825189 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2825189 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001/tempDir-001/control/cores/collection1/data/]
   [junit4]   2> 2825190 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2825325 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2825325 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2825326 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2825326 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2825327 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1500110363, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 2825327 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@ab43500[collection1] main]
   [junit4]   2> 2825328 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 2825427 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 2825463 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2825463 INFO  (coreLoadExecutor-8426-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593663207392673792
   [junit4]   2> 2825465 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 2825466 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 2825466 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 2825466 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 2825466 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 2825467 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 2825467 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 2825467 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 2825468 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 2825468 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@ab43500[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2826228 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001/tempDir-001/shard0/cores/collection1
   [junit4]   2> 2826229 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T17:27:37-04:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
   [junit4]   2> 2826261 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.session DefaultSessionIdManager workerName=node0
   [junit4]   2> 2826261 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.session No SessionScavenger set, using defaults
   [junit4]   2> 2826261 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.session Scavenging every 660000ms
   [junit4]   2> 2826262 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5f0a6c2c{/,null,AVAILABLE}
   [junit4]   2> 2826262 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.AbstractConnector Started ServerConnector@7080c63c{HTTP/1.1,[http/1.1]}{127.0.0.1:61563}
   [junit4]   2> 2826262 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.e.j.s.Server Started @2830556ms
   [junit4]   2> 2826262 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/, hostPort=61563, coreRootDirectory=/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001/tempDir-001/shard0/cores}
   [junit4]   2> 2826263 ERROR (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
   [junit4]   2> 2826263 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.s.SolrDispatchFilter  ___      _       Welcome to Apache Solr™ version 8.0.0
   [junit4]   2> 2826263 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _   Starting in standalone mode on port null
   [junit4]   2> 2826263 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_|  Install dir: null
   [junit4]   2> 2826263 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.s.SolrDispatchFilter |___/\___/_|_|    Start time: 2018-02-28T16:34:30.692Z
   [junit4]   2> 2826264 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.SolrXmlConfig Loading container configuration from /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001/tempDir-001/shard0/solr.xml
   [junit4]   2> 2826267 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
   [junit4]   2> 2826267 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
   [junit4]   2> 2826268 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@260b2233, but no JMX reporters were configured - adding default JMX reporter.
   [junit4]   2> 2826341 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@260b2233
   [junit4]   2> 2826353 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@260b2233
   [junit4]   2> 2826353 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@260b2233
   [junit4]   2> 2826355 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001/tempDir-001/shard0/cores
   [junit4]   2> 2826355 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
   [junit4]   2> 2826382 INFO  (coreLoadExecutor-8437-thread-1) [    ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
   [junit4]   2> 2826382 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib, /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1/lib/classes]
   [junit4]   2> 2826412 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 8.0.0
   [junit4]   2> 2826475 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
   [junit4]   2> 2826658 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
   [junit4]   2> 2826684 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1, trusted=true
   [junit4]   2> 2826685 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@260b2233
   [junit4]   2> 2826685 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
   [junit4]   2> 2826685 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/core/src/test-files/solr/collection1], dataDir=[/export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001/tempDir-001/shard0/cores/collection1/data/]
   [junit4]   2> 2826687 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=17, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
   [junit4]   2> 2826835 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
   [junit4]   2> 2826835 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
   [junit4]   2> 2826837 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
   [junit4]   2> 2826837 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
   [junit4]   2> 2826838 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1500110363, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
   [junit4]   2> 2826839 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@396efc26[collection1] main]
   [junit4]   2> 2826839 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
   [junit4]   2> 2826885 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
   [junit4]   2> 2826985 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
   [junit4]   2> 2826985 INFO  (coreLoadExecutor-8437-thread-1) [    x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1593663208988606464
   [junit4]   2> 2826989 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
   [junit4]   2> 2826993 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
   [junit4]   2> 2826993 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
   [junit4]   2> 2826993 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
   [junit4]   2> 2826994 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
   [junit4]   2> 2826994 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
   [junit4]   2> 2826995 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
   [junit4]   2> 2826995 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
   [junit4]   2> 2826995 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
   [junit4]   2> 2826996 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@396efc26[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
   [junit4]   2> 2827496 INFO  (TEST-TestDistributedSearch.test-seed#[21DE6392D67EB465]) [    ] o.a.s.SolrTestCaseJ4 ###Starting test
   [junit4]   2> 2827504 INFO  (qtp759593293-23350) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1593663209531768832)} 0 6
   [junit4]   2> 2827535 INFO  (qtp828035210-23370) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1593663209538060288)} 0 25
   [junit4]   2> 2827537 INFO  (qtp759593293-23359) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[1 (1593663209566371840)]} 0 1
   [junit4]   2> 2827542 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[1 (1593663209571614720)]} 0 1
   [junit4]   2> 2827543 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[2 (1593663209572663296)]} 0 0
   [junit4]   2> 2827544 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[2 (1593663209574760448)]} 0 0
   [junit4]   2> 2827545 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[3 (1593663209575809024)]} 0 0
   [junit4]   2> 2827547 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[3 (1593663209576857600)]} 0 0
   [junit4]   2> 2827548 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[4 (1593663209578954752)]} 0 0
   [junit4]   2> 2827549 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[4 (1593663209578954752)]} 0 0
   [junit4]   2> 2827550 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[5 (1593663209580003328)]} 0 0
   [junit4]   2> 2827550 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[5 (1593663209581051904)]} 0 0
   [junit4]   2> 2827551 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[6 (1593663209582100480)]} 0 0
   [junit4]   2> 2827552 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[6 (1593663209583149056)]} 0 0
   [junit4]   2> 2827553 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[7 (1593663209584197632)]} 0 0
   [junit4]   2> 2827554 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[7 (1593663209584197632)]} 0 0
   [junit4]   2> 2827555 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[8 (1593663209586294784)]} 0 0
   [junit4]   2> 2827556 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[8 (1593663209587343360)]} 0 0
   [junit4]   2> 2827557 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[9 (1593663209588391936)]} 0 0
   [junit4]   2> 2827558 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[9 (1593663209589440512)]} 0 0
   [junit4]   2> 2827558 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1593663209589440512,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2827558 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7225b841 commitCommandVersion:1593663209589440512
   [junit4]   2> 2827583 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@72c997b4[collection1] main]
   [junit4]   2> 2827583 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2827585 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@72c997b4[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C9)))}
   [junit4]   2> 2827585 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 27
   [junit4]   2> 2827598 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1593663209631383552,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2827598 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@eec7d9e commitCommandVersion:1593663209631383552
   [junit4]   2> 2827709 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@70b2a3e7[collection1] main]
   [junit4]   2> 2827710 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2827712 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@70b2a3e7[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C9)))}
   [junit4]   2> 2827712 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 113
   [junit4]   2> 2827714 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[10 (1593663209750921216)]} 0 2
   [junit4]   2> 2827717 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[10 (1593663209754066944)]} 0 1
   [junit4]   2> 2827731 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[11 (1593663209769795584)]} 0 0
   [junit4]   2> 2827732 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[11 (1593663209770844160)]} 0 0
   [junit4]   2> 2827733 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[12 (1593663209771892736)]} 0 0
   [junit4]   2> 2827750 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[12 (1593663209789718528)]} 0 0
   [junit4]   2> 2827766 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[13 (1593663209807544320)]} 0 0
   [junit4]   2> 2827767 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[13 (1593663209808592896)]} 0 0
   [junit4]   2> 2827774 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[1001 (1593663209809641472)]} 0 6
   [junit4]   2> 2827775 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[1001 (1593663209815932928)]} 0 0
   [junit4]   2> 2827775 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[14 (1593663209816981504)]} 0 0
   [junit4]   2> 2827776 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[14 (1593663209818030080)]} 0 0
   [junit4]   2> 2827777 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[15 (1593663209819078656)]} 0 0
   [junit4]   2> 2827778 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[15 (1593663209819078656)]} 0 0
   [junit4]   2> 2827778 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[16 (1593663209820127232)]} 0 0
   [junit4]   2> 2827779 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[16 (1593663209821175808)]} 0 0
   [junit4]   2> 2827780 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[17 (1593663209822224384)]} 0 0
   [junit4]   2> 2827781 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[17 (1593663209823272960)]} 0 0
   [junit4]   2> 2827785 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[100 (1593663209827467264)]} 0 0
   [junit4]   2> 2827786 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[100 (1593663209828515840)]} 0 0
   [junit4]   2> 2827787 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[101 (1593663209829564416)]} 0 0
   [junit4]   2> 2827788 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[101 (1593663209830612992)]} 0 0
   [junit4]   2> 2827789 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[102 (1593663209830612992)]} 0 0
   [junit4]   2> 2827789 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[102 (1593663209831661568)]} 0 0
   [junit4]   2> 2827790 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[103 (1593663209832710144)]} 0 0
   [junit4]   2> 2827790 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[103 (1593663209832710144)]} 0 0
   [junit4]   2> 2827791 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[104 (1593663209833758720)]} 0 0
   [junit4]   2> 2827792 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[104 (1593663209833758720)]} 0 0
   [junit4]   2> 2827792 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[105 (1593663209834807296)]} 0 0
   [junit4]   2> 2827793 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[105 (1593663209834807296)]} 0 0
   [junit4]   2> 2827793 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[106 (1593663209835855872)]} 0 0
   [junit4]   2> 2827794 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[106 (1593663209836904448)]} 0 0
   [junit4]   2> 2827794 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[107 (1593663209836904448)]} 0 0
   [junit4]   2> 2827795 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[107 (1593663209837953024)]} 0 0
   [junit4]   2> 2827796 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[108 (1593663209837953024)]} 0 0
   [junit4]   2> 2827800 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[108 (1593663209843195904)]} 0 0
   [junit4]   2> 2827801 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[109 (1593663209844244480)]} 0 0
   [junit4]   2> 2827802 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[109 (1593663209844244480)]} 0 0
   [junit4]   2> 2827802 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[110 (1593663209845293056)]} 0 0
   [junit4]   2> 2827826 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[110 (1593663209870458880)]} 0 0
   [junit4]   2> 2827836 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[111 (1593663209880944640)]} 0 0
   [junit4]   2> 2827837 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[111 (1593663209881993216)]} 0 0
   [junit4]   2> 2827838 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[112 (1593663209883041792)]} 0 0
   [junit4]   2> 2827839 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[112 (1593663209884090368)]} 0 0
   [junit4]   2> 2827840 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[113 (1593663209885138944)]} 0 0
   [junit4]   2> 2827841 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[113 (1593663209886187520)]} 0 0
   [junit4]   2> 2827841 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[114 (1593663209886187520)]} 0 0
   [junit4]   2> 2827842 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[114 (1593663209887236096)]} 0 0
   [junit4]   2> 2827844 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[115 (1593663209888284672)]} 0 0
   [junit4]   2> 2827844 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[115 (1593663209889333248)]} 0 0
   [junit4]   2> 2827845 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[116 (1593663209890381824)]} 0 0
   [junit4]   2> 2827846 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[116 (1593663209891430400)]} 0 0
   [junit4]   2> 2827848 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[117 (1593663209892478976)]} 0 0
   [junit4]   2> 2827849 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[117 (1593663209893527552)]} 0 0
   [junit4]   2> 2827849 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[118 (1593663209894576128)]} 0 0
   [junit4]   2> 2827850 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[118 (1593663209895624704)]} 0 0
   [junit4]   2> 2827851 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[119 (1593663209896673280)]} 0 0
   [junit4]   2> 2827852 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[119 (1593663209897721856)]} 0 0
   [junit4]   2> 2827854 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[120 (1593663209899819008)]} 0 0
   [junit4]   2> 2827855 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[120 (1593663209900867584)]} 0 0
   [junit4]   2> 2827856 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[121 (1593663209901916160)]} 0 0
   [junit4]   2> 2827857 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[121 (1593663209902964736)]} 0 0
   [junit4]   2> 2827862 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[122 (1593663209908207616)]} 0 0
   [junit4]   2> 2827863 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[122 (1593663209908207616)]} 0 0
   [junit4]   2> 2827863 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[123 (1593663209909256192)]} 0 0
   [junit4]   2> 2827864 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[123 (1593663209910304768)]} 0 0
   [junit4]   2> 2827865 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[124 (1593663209911353344)]} 0 0
   [junit4]   2> 2827866 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[124 (1593663209912401920)]} 0 0
   [junit4]   2> 2827867 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[125 (1593663209913450496)]} 0 0
   [junit4]   2> 2827868 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[125 (1593663209913450496)]} 0 0
   [junit4]   2> 2827868 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[126 (1593663209914499072)]} 0 0
   [junit4]   2> 2827869 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[126 (1593663209915547648)]} 0 0
   [junit4]   2> 2827870 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[127 (1593663209916596224)]} 0 0
   [junit4]   2> 2827871 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[127 (1593663209917644800)]} 0 0
   [junit4]   2> 2827871 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[128 (1593663209917644800)]} 0 0
   [junit4]   2> 2827872 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[128 (1593663209918693376)]} 0 0
   [junit4]   2> 2827873 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[129 (1593663209919741952)]} 0 0
   [junit4]   2> 2827874 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[129 (1593663209920790528)]} 0 0
   [junit4]   2> 2827875 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[130 (1593663209921839104)]} 0 0
   [junit4]   2> 2827876 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[130 (1593663209922887680)]} 0 0
   [junit4]   2> 2827877 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[131 (1593663209922887680)]} 0 0
   [junit4]   2> 2827877 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[131 (1593663209923936256)]} 0 0
   [junit4]   2> 2827878 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[132 (1593663209924984832)]} 0 0
   [junit4]   2> 2827879 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[132 (1593663209926033408)]} 0 0
   [junit4]   2> 2827905 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[133 (1593663209953296384)]} 0 0
   [junit4]   2> 2827916 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[133 (1593663209964830720)]} 0 0
   [junit4]   2> 2827946 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[134 (1593663209995239424)]} 0 0
   [junit4]   2> 2827946 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[134 (1593663209996288000)]} 0 0
   [junit4]   2> 2827947 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[135 (1593663209997336576)]} 0 0
   [junit4]   2> 2827947 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[135 (1593663209997336576)]} 0 0
   [junit4]   2> 2827948 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[136 (1593663209998385152)]} 0 0
   [junit4]   2> 2827948 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[136 (1593663209998385152)]} 0 0
   [junit4]   2> 2827949 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[137 (1593663209998385153)]} 0 0
   [junit4]   2> 2827949 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[137 (1593663209999433728)]} 0 0
   [junit4]   2> 2827949 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[138 (1593663209999433728)]} 0 0
   [junit4]   2> 2827950 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[138 (1593663210000482304)]} 0 0
   [junit4]   2> 2827950 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[139 (1593663210000482304)]} 0 0
   [junit4]   2> 2827951 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[139 (1593663210001530880)]} 0 0
   [junit4]   2> 2827951 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[140 (1593663210001530880)]} 0 0
   [junit4]   2> 2827952 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[140 (1593663210002579456)]} 0 0
   [junit4]   2> 2827952 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[141 (1593663210002579456)]} 0 0
   [junit4]   2> 2827953 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[141 (1593663210003628032)]} 0 0
   [junit4]   2> 2827954 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[142 (1593663210004676608)]} 0 0
   [junit4]   2> 2827954 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[142 (1593663210004676608)]} 0 0
   [junit4]   2> 2827955 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[143 (1593663210005725184)]} 0 0
   [junit4]   2> 2827956 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[143 (1593663210006773760)]} 0 0
   [junit4]   2> 2827956 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[144 (1593663210006773760)]} 0 0
   [junit4]   2> 2827957 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[144 (1593663210006773761)]} 0 0
   [junit4]   2> 2827957 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[145 (1593663210007822336)]} 0 0
   [junit4]   2> 2827957 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[145 (1593663210007822336)]} 0 0
   [junit4]   2> 2827958 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[146 (1593663210008870912)]} 0 0
   [junit4]   2> 2827958 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[146 (1593663210008870912)]} 0 0
   [junit4]   2> 2827959 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[147 (1593663210009919488)]} 0 0
   [junit4]   2> 2827959 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[147 (1593663210009919488)]} 0 0
   [junit4]   2> 2827960 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[148 (1593663210009919489)]} 0 0
   [junit4]   2> 2827960 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[148 (1593663210010968064)]} 0 0
   [junit4]   2> 2827961 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[149 (1593663210010968064)]} 0 0
   [junit4]   2> 2827969 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={wt=javabin&version=2}{add=[149 (1593663210012016640)]} 0 7
   [junit4]   2> 2827969 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1593663210020405248,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2827970 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@7225b841 commitCommandVersion:1593663210020405248
   [junit4]   2> 2827990 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@4f9113d[collection1] main]
   [junit4]   2> 2827990 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2827995 INFO  (searcherExecutor-8427-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@4f9113d[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C9) Uninverting(_1(8.0.0):C59)))}
   [junit4]   2> 2827996 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 26
   [junit4]   2> 2827999 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1593663210051862528,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
   [junit4]   2> 2827999 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.SolrIndexWriter Calling setCommitData with IW:org.apache.solr.update.SolrIndexWriter@eec7d9e commitCommandVersion:1593663210051862528
   [junit4]   2> 2828014 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2620c6b0[collection1] main]
   [junit4]   2> 2828023 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
   [junit4]   2> 2828027 INFO  (searcherExecutor-8438-thread-1-processing-x:collection1) [    x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@2620c6b0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader(Uninverting(_0(8.0.0):C9) Uninverting(_1(8.0.0):C59)))}
   [junit4]   2> 2828027 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1]  webapp= path=/update params={waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 28
   [junit4]   2> 2828029 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.h.RequestHandlerBase Ignoring exception matching parameter cannot be negative
   [junit4]   2> 2828029 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*&distrib=false&start=-1&wt=javabin&version=2} status=400 QTime=0
   [junit4]   2> 2828030 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.h.RequestHandlerBase Ignoring exception matching parameter cannot be negative
   [junit4]   2> 2828030 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*&distrib=false&start=0&rows=-1&wt=javabin&version=2} status=400 QTime=0
   [junit4]   2> 2828031 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_ti1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828036 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_ti1+desc&shard.url=http://127.0.0.1:61563//collection1|[ff01::114]:33332/|[ff01::213]:33332/|[ff01::083]:33332/&rows=10&version=2&q=*:*&NOW=1519835672462&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828038 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672462&ids=143,12,125,136,147,137,126,6,116,130&isShard=true&shard.url=http://127.0.0.1:61563//collection1|[ff01::114]:33332/|[ff01::213]:33332/|[ff01::083]:33332/&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828107 INFO  (qtp828035210-23375) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=http://127.0.0.1:61563//collection1|[ff01::114]:33332/|[ff01::213]:33332/|[ff01::083]:33332/&sort=n_ti1+desc&wt=javabin&version=2} hits=68 status=0 QTime=73
   [junit4]   2> 2828108 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_ti1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828159 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_ti1+asc&shard.url=[ff01::114]:33332/|[ff01::083]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672538&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828161 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672538&ids=11,121,135,103,7,1001,106,119,142,120&isShard=true&shard.url=[ff01::114]:33332/|[ff01::083]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828268 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::114]:33332/|[ff01::083]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&sort=n_ti1+asc&wt=javabin&version=2} hits=68 status=0 QTime=158
   [junit4]   2> 2828269 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_f1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828274 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_f1+desc&shard.url=http://127.0.0.1:61563//collection1|[ff01::114]:33332/&rows=10&version=2&q=*:*&NOW=1519835672703&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828276 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672703&ids=133,134,145,146,147,127,128,117,9,140&isShard=true&shard.url=http://127.0.0.1:61563//collection1|[ff01::114]:33332/&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828284 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=http://127.0.0.1:61563//collection1|[ff01::114]:33332/&sort=n_f1+desc&wt=javabin&version=2} hits=68 status=0 QTime=10
   [junit4]   2> 2828285 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_f1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828287 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_f1+asc&shard.url=http://127.0.0.1:61563//collection1|[ff01::213]:33332/&rows=10&version=2&q=*:*&NOW=1519835672715&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828288 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672715&ids=11,12,13,124,14,125,103,5,129,118&isShard=true&shard.url=http://127.0.0.1:61563//collection1|[ff01::213]:33332/&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828302 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=http://127.0.0.1:61563//collection1|[ff01::213]:33332/&sort=n_f1+asc&wt=javabin&version=2} hits=68 status=0 QTime=15
   [junit4]   2> 2828303 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_tf1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828304 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_tf1+desc&shard.url=http://127.0.0.1:61563//collection1|[ff01::083]:33332/|[ff01::213]:33332/|[ff01::114]:33332/&rows=10&version=2&q=*:*&NOW=1519835672733&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828305 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672733&ids=110,111,2,114,127,17,128,106,9,131&isShard=true&shard.url=http://127.0.0.1:61563//collection1|[ff01::083]:33332/|[ff01::213]:33332/|[ff01::114]:33332/&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828309 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=http://127.0.0.1:61563//collection1|[ff01::083]:33332/|[ff01::213]:33332/|[ff01::114]:33332/&sort=n_tf1+desc&wt=javabin&version=2} hits=68 status=0 QTime=5
   [junit4]   2> 2828309 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_tf1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828311 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_tf1+asc&shard.url=[ff01::083]:33332/|[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672739&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828312 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672739&ids=143,122,1,134,14,138,116,117,139,7&isShard=true&shard.url=[ff01::083]:33332/|[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828312 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::083]:33332/|[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&sort=n_tf1+asc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828313 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_d1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828315 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_d1+desc&shard.url=http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672743&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828316 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672743&ids=1,122,101,14,3,103,127,17,128,119&isShard=true&shard.url=http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828316 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=http://127.0.0.1:61563//collection1&sort=n_d1+desc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828317 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_d1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828319 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_d1+asc&shard.url=[ff01::213]:33332/|[ff01::083]:33332/|http://127.0.0.1:61563//collection1|[ff01::114]:33332/&rows=10&version=2&q=*:*&NOW=1519835672747&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828320 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672747&ids=100,133,144,145,123,113,124,104,116,107&isShard=true&shard.url=[ff01::213]:33332/|[ff01::083]:33332/|http://127.0.0.1:61563//collection1|[ff01::114]:33332/&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828321 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::213]:33332/|[ff01::083]:33332/|http://127.0.0.1:61563//collection1|[ff01::114]:33332/&sort=n_d1+asc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828322 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_td1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828324 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_td1+desc&shard.url=[ff01::083]:33332/|[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672752&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828325 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672752&ids=110,101,146,137,105,6,106,118,8,140&isShard=true&shard.url=[ff01::083]:33332/|[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828325 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::083]:33332/|[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&sort=n_td1+desc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828326 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_td1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828328 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_td1+asc&shard.url=[ff01::114]:33332/|[ff01::083]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672756&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828329 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672756&ids=11,144,13,135,102,147,148,149,127,117&isShard=true&shard.url=[ff01::114]:33332/|[ff01::083]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828330 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::114]:33332/|[ff01::083]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&sort=n_td1+asc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828331 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_l1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828332 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_l1+desc&shard.url=[ff01::213]:33332/|[ff01::114]:33332/|http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672761&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828333 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672761&ids=11,122,4,15,114,103,17,117,9,109&isShard=true&shard.url=[ff01::213]:33332/|[ff01::114]:33332/|http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828334 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::213]:33332/|[ff01::114]:33332/|http://127.0.0.1:61563//collection1&sort=n_l1+desc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828335 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_l1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828336 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_l1+asc&shard.url=[ff01::083]:33332/|http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672764&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828337 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672764&ids=134,146,136,5,104,148,127,107,119,120&isShard=true&shard.url=[ff01::083]:33332/|http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828337 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::083]:33332/|http://127.0.0.1:61563//collection1&sort=n_l1+asc&wt=javabin&version=2} hits=68 status=0 QTime=1
   [junit4]   2> 2828338 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_tl1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828340 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_tl1+desc&shard.url=http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672768&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828341 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672768&ids=123,101,145,136,104,115,105,128,106,129&isShard=true&shard.url=http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828341 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=http://127.0.0.1:61563//collection1&sort=n_tl1+desc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828354 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_tl1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828356 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_tl1+asc&shard.url=[ff01::083]:33332/|http://127.0.0.1:61563//collection1|[ff01::213]:33332/|[ff01::114]:33332/&rows=10&version=2&q=*:*&NOW=1519835672784&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828357 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672784&ids=11,110,1,124,147,126,5,116,127,130&isShard=true&shard.url=[ff01::083]:33332/|http://127.0.0.1:61563//collection1|[ff01::213]:33332/|[ff01::114]:33332/&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828358 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::083]:33332/|http://127.0.0.1:61563//collection1|[ff01::213]:33332/|[ff01::114]:33332/&sort=n_tl1+asc&wt=javabin&version=2} hits=68 status=0 QTime=3
   [junit4]   2> 2828359 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_dt1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828362 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_dt1+desc&shard.url=[ff01::083]:33332/|http://127.0.0.1:61563//collection1|[ff01::114]:33332/&rows=10&version=2&q=*:*&NOW=1519835672789&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828363 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672789&ids=133,124,147,115,127,149,105,1001,117,119&isShard=true&shard.url=[ff01::083]:33332/|http://127.0.0.1:61563//collection1|[ff01::114]:33332/&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828364 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::083]:33332/|http://127.0.0.1:61563//collection1|[ff01::114]:33332/&sort=n_dt1+desc&wt=javabin&version=2} hits=68 status=0 QTime=4
   [junit4]   2> 2828365 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_dt1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828374 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_dt1+asc&shard.url=http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672802&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828375 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672802&ids=12,111,145,114,103,6,106,128,129,9&isShard=true&shard.url=http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828376 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=http://127.0.0.1:61563//collection1&sort=n_dt1+asc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828377 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_tdt1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828379 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_tdt1+desc&shard.url=[ff01::114]:33332/|http://127.0.0.1:61563//collection1|[ff01::213]:33332/&rows=10&version=2&q=*:*&NOW=1519835672807&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828380 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672807&ids=135,124,4,114,105,149,7,118,129,120&isShard=true&shard.url=[ff01::114]:33332/|http://127.0.0.1:61563//collection1|[ff01::213]:33332/&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828380 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::114]:33332/|http://127.0.0.1:61563//collection1|[ff01::213]:33332/&sort=n_tdt1+desc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828381 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_tdt1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828383 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_tdt1+asc&shard.url=http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672811&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828384 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672811&ids=145,146,103,138,17,6,128,106,8,109&isShard=true&shard.url=http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828384 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=http://127.0.0.1:61563//collection1&sort=n_tdt1+asc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828385 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=a_i1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828398 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=a_i1+desc&shard.url=[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672819&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828400 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672819&ids=1,12,2,13,3,5,7,8,9,10&isShard=true&shard.url=[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828401 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&sort=a_i1+desc&wt=javabin&version=2} hits=68 status=0 QTime=11
   [junit4]   2> 2828403 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort={!func}testfunc(add(a_i1,5))+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828411 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort={!func}testfunc(add(a_i1,5))+desc&shard.url=[ff01::083]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672833&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828412 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672833&ids=1,12,2,13,3,5,7,8,9,10&isShard=true&shard.url=[ff01::083]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828413 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::083]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&sort={!func}testfunc(add(a_i1,5))+desc&wt=javabin&version=2} hits=68 status=0 QTime=8
   [junit4]   2> 2828414 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=a_i1[*+TO+*]&distrib=false&sort=a_i1+asc&wt=javabin&version=2} hits=13 status=0 QTime=0
   [junit4]   2> 2828416 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=a_i1+asc&shard.url=[ff01::083]:33332/|[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&rows=10&version=2&q=a_i1[*+TO+*]&NOW=1519835672844&isShard=true&wt=javabin} hits=13 status=0 QTime=0
   [junit4]   2> 2828417 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=a_i1[*+TO+*]&df=text&distrib=false&shards.purpose=64&NOW=1519835672844&ids=11,12,1,13,2,3,4,6,7,9&isShard=true&shard.url=[ff01::083]:33332/|[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828426 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=a_i1[*+TO+*]&shards=[ff01::083]:33332/|[ff01::114]:33332/|[ff01::213]:33332/|http://127.0.0.1:61563//collection1&sort=a_i1+asc&wt=javabin&version=2} hits=13 status=0 QTime=11
   [junit4]   2> 2828427 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=a_i1+asc,+id+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828429 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=a_i1+asc,+id+desc&shard.url=http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672858&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828430 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&shards.purpose=64&NOW=1519835672858&ids=11,12,1,13,2,3,4,6,7,9&isShard=true&shard.url=http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828431 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=http://127.0.0.1:61563//collection1&sort=a_i1+asc,+id+desc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828432 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&fl=*,score&sort=a_i1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828433 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&sort=a_i1+desc&shard.url=[ff01::114]:33332/|http://127.0.0.1:61563//collection1|[ff01::213]:33332/|[ff01::083]:33332/&rows=10&version=2&q=*:*&NOW=1519835672862&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828434 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&fl=*,score&shards.purpose=64&NOW=1519835672862&ids=1,12,2,13,3,5,7,8,9,10&isShard=true&shard.url=[ff01::114]:33332/|http://127.0.0.1:61563//collection1|[ff01::213]:33332/|[ff01::083]:33332/&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828435 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::114]:33332/|http://127.0.0.1:61563//collection1|[ff01::213]:33332/|[ff01::083]:33332/&fl=*,score&sort=a_i1+desc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828436 INFO  (qtp759593293-23361) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&fl=*,score&sort=n_tl1+asc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828437 INFO  (qtp828035210-23372) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&sort=n_tl1+asc&shard.url=[ff01::083]:33332/|[ff01::213]:33332/|[ff01::114]:33332/|http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672866&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828438 INFO  (qtp828035210-23377) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&df=text&distrib=false&fl=*,score&shards.purpose=64&NOW=1519835672866&ids=11,110,1,124,147,126,5,116,127,130&isShard=true&shard.url=[ff01::083]:33332/|[ff01::213]:33332/|[ff01::114]:33332/|http://127.0.0.1:61563//collection1&wt=javabin&version=2} status=0 QTime=0
   [junit4]   2> 2828439 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&shards=[ff01::083]:33332/|[ff01::213]:33332/|[ff01::114]:33332/|http://127.0.0.1:61563//collection1&fl=*,score&sort=n_tl1+asc&wt=javabin&version=2} hits=68 status=0 QTime=2
   [junit4]   2> 2828440 INFO  (qtp759593293-23353) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={q=*:*&distrib=false&sort=n_tl1+desc&wt=javabin&version=2} hits=68 status=0 QTime=0
   [junit4]   2> 2828441 INFO  (qtp828035210-23373) [    x:collection1] o.a.s.c.S.Request [collection1]  webapp= path=/select params={df=text&distrib=false&fl=id&shards.purpose=4&start=0&fsv=true&sort=n_tl1+desc&shard.url=[ff01::114]:33332/|http://127.0.0.1:61563//collection1&rows=10&version=2&q=*:*&NOW=1519835672869&isShard=true&wt=javabin} hits=68 status=0 QTime=0
   [junit4]   2> 2828449 INFO  (qtp828035210-23377) [    x

[...truncated too long message...]

.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
   [junit4]    > 	at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131)
   [junit4]    > 	at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:382)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
   [junit4]    > 	at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]    > 	at __randomizedtesting.SeedInfo.seed([21DE6392D67EB465:A98A5C487882D99D]:0)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:643)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:255)
   [junit4]    > 	at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:244)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:194)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:942)
   [junit4]    > 	at org.apache.solr.client.solrj.SolrClient.query(SolrClient.java:957)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.queryRandomUpServer(TestDistributedSearch.java:1168)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.queryPartialResults(TestDistributedSearch.java:1130)
   [junit4]    > 	at org.apache.solr.TestDistributedSearch.test(TestDistributedSearch.java:992)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsRepeatStatement.callStatement(BaseDistributedSearchTestCase.java:1019)
   [junit4]    > 	at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
   [junit4]    > 	at java.lang.Thread.run(Thread.java:748)
   [junit4]   2> NOTE: leaving temporary files on disk at: /export/home/jenkins/workspace/Lucene-Solr-master-Solaris/solr/build/solr-core/test/J0/temp/solr.TestDistributedSearch_21DE6392D67EB465-001
   [junit4]   2> NOTE: test params are: codec=Asserting(Lucene70): {severity=FST50, foo_sev_enum=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), SubjectTerms_mfacet=PostingsFormat(name=Memory), multiDefault=PostingsFormat(name=LuceneVarGapFixedInterval), rnd_b=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), a_s=FST50, oddField_s=FST50, lowerfilt1and2=PostingsFormat(name=LuceneVarGapFixedInterval), a_t=PostingsFormat(name=Memory), foo_b=FST50, lowerfilt=PostingsFormat(name=LuceneVarGapFixedInterval), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128))), text=FST50}, docValues:{other_tl1=DocValuesFormat(name=Lucene70), range_facet_l_dv=DocValuesFormat(name=Asserting), n_l1=DocValuesFormat(name=Lucene70), a_n_tdt=DocValuesFormat(name=Asserting), intDefault=DocValuesFormat(name=Lucene70), n_td1=DocValuesFormat(name=Memory), n_d1=DocValuesFormat(name=Lucene70), range_facet_l=DocValuesFormat(name=Lucene70), n_f1=DocValuesFormat(name=Memory), n_tl1=DocValuesFormat(name=Memory), n_tf1=DocValuesFormat(name=Lucene70), intDvoDefault=DocValuesFormat(name=Lucene70), timestamp=DocValuesFormat(name=Lucene70), severity=DocValuesFormat(name=Lucene70), foo_sev_enum=DocValuesFormat(name=Asserting), n_dt1=DocValuesFormat(name=Memory), a_i1=DocValuesFormat(name=Lucene70), b_n_tdt=DocValuesFormat(name=Lucene70), n_ti1=DocValuesFormat(name=Asserting), _version_=DocValuesFormat(name=Lucene70), n_tdt1=DocValuesFormat(name=Lucene70), id_i1=DocValuesFormat(name=Memory), foo_d=DocValuesFormat(name=Asserting), range_facet_i_dv=DocValuesFormat(name=Lucene70), foo_f=DocValuesFormat(name=Lucene70)}, maxPointsInLeafNode=1371, maxMBSortInHeap=6.059914649219882, sim=Asserting(org.apache.lucene.search.similarities.AssertingSimilarity@64d3ea18), locale=es-CO, timezone=Etc/GMT-3
   [junit4]   2> NOTE: SunOS 5.11 amd64/Oracle Corporation 1.8.0_162 (64-bit)/cpus=3,threads=1,free=125187488,total=518979584
   [junit4]   2> NOTE: All tests run in this JVM: [UnloadDistributedZkTest, SimpleCollectionCreateDeleteTest, SolrGangliaReporterTest, GraphQueryTest, MetricTriggerTest, ReplicaListTransformerTest, LukeRequestHandlerTest, BaseCdcrDistributedZkTest, AnalyticsQueryTest, ComputePlanActionTest, TestCryptoKeys, SampleTest, TestMergePolicyConfig, SystemLogListenerTest, TestBlobHandler, SuggestComponentTest, AtomicUpdateProcessorFactoryTest, TestSchemaManager, TestLeaderInitiatedRecoveryThread, TestInPlaceUpdatesStandalone, JavabinLoaderTest, TestComputePlanAction, TermsComponentTest, TestSolrCloudWithDelegationTokens, TestElisionMultitermQuery, SuggesterTSTTest, TestManagedSchemaThreadSafety, TestFieldCacheVsDocValues, OpenExchangeRatesOrgProviderTest, SolrSlf4jReporterTest, SolrCoreMetricManagerTest, TestSimDistributedQueue, ZkShardTermsTest, SolrRequestParserTest, HdfsTlogReplayBufferedWhileIndexingTest, ConnectionReuseTest, TestCloudInspectUtil, TestCollationField, SpatialFilterTest, DistributedFacetSimpleRefinementLongTailTest, TestSolr4Spatial2, TestDocBasedVersionConstraints, SpellCheckCollatorWithCollapseTest, SharedFSAutoReplicaFailoverTest, ParsingFieldUpdateProcessorsTest, TestSegmentSorting, TestPayloadScoreQParserPlugin, DistributedQueryComponentOptimizationTest, HdfsAutoAddReplicasIntegrationTest, BigEndianAscendingWordSerializerTest, TestReplicationHandler, ClassificationUpdateProcessorFactoryTest, ConcurrentDeleteAndCreateCollectionTest, TestExactStatsCache, ZkStateWriterTest, NodeLostTriggerTest, ReplaceNodeTest, TestSolrXml, TestNodeLostTrigger, BooleanFieldTest, UniqFieldsUpdateProcessorFactoryTest, TestLocalFSCloudBackupRestore, ZkCLITest, ShardRoutingCustomTest, VMParamsZkACLAndCredentialsProvidersTest, TestFiltering, BlockJoinFacetRandomTest, AlternateDirectoryTest, TestSolrJ, ResponseHeaderTest, TestTestInjection, TestLargeCluster, TestCollationFieldDocValues, SpatialRPTFieldTypeTest, TestEmbeddedSolrServerAdminHandler, CollectionReloadTest, SegmentsInfoRequestHandlerTest, TestCloudRecovery, TestMaxTokenLenTokenizer, TestConfigOverlay, RuleEngineTest, CopyFieldTest, TestImpersonationWithHadoopAuth, ChaosMonkeyNothingIsSafeWithPullReplicasTest, BasicZkTest, SpatialHeatmapFacetsTest, RecoveryZkTest, TestSolrConfigHandlerConcurrent, TestPrepRecovery, FastVectorHighlighterTest, TestSolrDeletionPolicy1, NumericFieldsTest, TestRealTimeGet, TestUseDocValuesAsStored2, TestNamedUpdateProcessors, InfoHandlerTest, ManagedSchemaRoundRobinCloudTest, PropertiesRequestHandlerTest, FileUtilsTest, DistribJoinFromCollectionTest, TestBinaryField, XmlUpdateRequestHandlerTest, TestSolrCloudWithSecureImpersonation, TestSuggestSpellingConverter, TestReloadAndDeleteDocs, TriggerIntegrationTest, TestPivotHelperCode, TestFieldCollectionResource, OverseerModifyCollectionTest, DirectSolrSpellCheckerTest, DistributedExpandComponentTest, TestConfigSetProperties, ConvertedLegacyTest, TestClassicSimilarityFactory, StatsComponentTest, DeleteNodeTest, DirectUpdateHandlerOptimizeTest, TestZkChroot, SOLR749Test, TestLegacyFieldCache, MoveReplicaHDFSFailoverTest, TestFieldCacheSort, TestOmitPositions, TestSolrQueryResponse, TlogReplayBufferedWhileIndexingTest, CollectionsAPIAsyncDistributedZkTest, TestTrie, TestEmbeddedSolrServerSchemaAPI, PluginInfoTest, TestLeaderElectionWithEmptyReplica, TestManagedResourceStorage, DateFieldTest, TestSimpleTextCodec, TestImplicitCoreProperties, TestNumericTokenStream, TestFaceting, CdcrBootstrapTest, SparseHLLTest, TestBinaryResponseWriter, AddBlockUpdateTest, CurrencyFieldTypeTest, CursorMarkTest, TestCollectionsAPIViaSolrCloudCluster, ClassificationUpdateProcessorTest, TestCharFilters, TestPullReplicaErrorHandling, LeaderElectionIntegrationTest, TestIBSimilarityFactory, TermVectorComponentDistributedTest, TestApiFramework, HighlighterTest, PolyFieldTest, TestSystemIdResolver, TestPKIAuthenticationPlugin, ConfigSetsAPITest, TestReRankQParserPlugin, TestTolerantUpdateProcessorRandomCloud, ExitableDirectoryReaderTest, SolrJmxReporterCloudTest, WordBreakSolrSpellCheckerTest, SolrCoreTest, TestNumericTerms64, AutoAddReplicasPlanActionTest, TestGraphMLResponseWriter, TestRangeQuery, NodeMutatorTest, TestCSVResponseWriter, TolerantUpdateProcessorTest, TestRequestStatusCollectionAPI, AddReplicaTest, TestPartialUpdateDeduplication, TestCloudManagedSchema, ExplicitHLLTest, TestPseudoReturnFields, AnalysisAfterCoreReloadTest, BasicAuthIntegrationTest, TestUtils, SpellingQueryConverterTest, TestCursorMarkWithoutUniqueKey, ResponseBuilderTest, TestMaxScoreQueryParser, DocExpirationUpdateProcessorFactoryTest, JSONWriterTest, DistribCursorPagingTest, RemoteQueryErrorTest, CoreAdminRequestStatusTest, RestartWhileUpdatingTest, TestSimpleQParserPlugin, PingRequestHandlerTest, TestStressInPlaceUpdates, BasicDistributedZkTest, ShardRoutingTest, FullSolrCloudDistribCmdsTest, TestRandomFaceting, TestRandomDVFaceting, TestDistributedSearch]
   [junit4] Completed [400/778 (1!)] on J0 in 57.61s, 1 test, 1 error <<< FAILURES!

[...truncated 49194 lines...]
[repro] Jenkins log URL: https://jenkins.thetaphi.de/job/Lucene-Solr-master-Solaris/1704/consoleText

[repro] Revision: 1485b7a4d72f5bf4123206d59716e75fb2706374

[repro] Ant options: "-Dargs=-XX:+UseCompressedOops -XX:+UseConcMarkSweepGC"

[...truncated 27 lines...]
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2
Setting ANT_1_8_2_HOME=/export/home/jenkins/tools/hudson.tasks.Ant_AntInstallation/ANT_1.8.2