You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2018/01/20 22:53:55 UTC
[JENKINS] Lucene-Solr-7.x-Linux (64bit/jdk-9.0.1) - Build # 1210 -
Unstable!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1210/
Java: 64bit/jdk-9.0.1 -XX:-UseCompressedOops -XX:+UseSerialGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.search.facet.DistributedFacetSimpleRefinementLongTailTest
Error Message:
1 thread leaked from SUITE scope at org.apache.solr.search.facet.DistributedFacetSimpleRefinementLongTailTest: 1) Thread[id=7009, name=qtp796745768-7009, state=TIMED_WAITING, group=TGRP-DistributedFacetSimpleRefinementLongTailTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2192) at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.search.facet.DistributedFacetSimpleRefinementLongTailTest:
1) Thread[id=7009, name=qtp796745768-7009, state=TIMED_WAITING, group=TGRP-DistributedFacetSimpleRefinementLongTailTest]
at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2192)
at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
at __randomizedtesting.SeedInfo.seed([B52E943B300BC393]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.search.facet.DistributedFacetSimpleRefinementLongTailTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=7009, name=qtp796745768-7009, state=TIMED_WAITING, group=TGRP-DistributedFacetSimpleRefinementLongTailTest] at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method) at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234) at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2192) at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308) at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373) at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708) at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=7009, name=qtp796745768-7009, state=TIMED_WAITING, group=TGRP-DistributedFacetSimpleRefinementLongTailTest]
at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2192)
at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
at __randomizedtesting.SeedInfo.seed([B52E943B300BC393]:0)
Build Log:
[...truncated 12179 lines...]
[junit4] Suite: org.apache.solr.search.facet.DistributedFacetSimpleRefinementLongTailTest
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/init-core-data-001
[junit4] 2> 427509 WARN (SUITE-DistributedFacetSimpleRefinementLongTailTest-seed#[B52E943B300BC393]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=15 numCloses=15
[junit4] 2> 427509 INFO (SUITE-DistributedFacetSimpleRefinementLongTailTest-seed#[B52E943B300BC393]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 427509 INFO (SUITE-DistributedFacetSimpleRefinementLongTailTest-seed#[B52E943B300BC393]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0)
[junit4] 2> 427509 INFO (SUITE-DistributedFacetSimpleRefinementLongTailTest-seed#[B52E943B300BC393]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 427510 INFO (SUITE-DistributedFacetSimpleRefinementLongTailTest-seed#[B52E943B300BC393]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /cy_add/j
[junit4] 2> 427635 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/control/cores/collection1
[junit4] 2> 427674 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T10:27:37+13:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 427681 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 427681 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 427681 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 427681 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6e8230d{/cy_add/j,null,AVAILABLE}
[junit4] 2> 427683 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5c603b21{SSL,[ssl, http/1.1]}{127.0.0.1:39877}
[junit4] 2> 427683 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.Server Started @429323ms
[junit4] 2> 427683 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/cy_add/j, hostPort=39877, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/control/cores}
[junit4] 2> 427684 ERROR (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 427684 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 427684 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 427684 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 427684 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-20T22:26:57.437302Z
[junit4] 2> 427684 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/control/solr.xml
[junit4] 2> 427687 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 427687 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 427688 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 427714 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 427723 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 427723 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 427725 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/control/cores
[junit4] 2> 427725 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 427726 INFO (coreLoadExecutor-1688-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 427726 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 427752 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 427773 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 427882 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 427887 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 427887 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 427887 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 427887 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/control/cores/collection1/data/]
[junit4] 2> 427888 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 427935 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 427935 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 427950 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 427950 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 427954 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1624550042, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 427955 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@496be25[collection1] main]
[junit4] 2> 427955 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 428035 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 428133 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 428133 INFO (searcherExecutor-1689-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 428133 INFO (coreLoadExecutor-1688-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1590152100982030336
[junit4] 2> 428134 INFO (searcherExecutor-1689-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 428134 INFO (searcherExecutor-1689-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 428134 INFO (searcherExecutor-1689-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 428134 INFO (searcherExecutor-1689-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 428134 INFO (searcherExecutor-1689-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 428134 INFO (searcherExecutor-1689-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 428135 INFO (searcherExecutor-1689-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 428135 INFO (searcherExecutor-1689-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 428136 INFO (searcherExecutor-1689-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@496be25[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 428248 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard0/cores/collection1
[junit4] 2> 428250 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T10:27:37+13:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 428250 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 428250 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 428250 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 428250 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@9026fe0{/cy_add/j,null,AVAILABLE}
[junit4] 2> 428251 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@26c7208b{SSL,[ssl, http/1.1]}{127.0.0.1:46523}
[junit4] 2> 428251 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.Server Started @429891ms
[junit4] 2> 428251 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/cy_add/j, hostPort=46523, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard0/cores}
[junit4] 2> 428251 ERROR (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 428251 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 428251 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 428251 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 428251 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-20T22:26:58.004855Z
[junit4] 2> 428252 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard0/solr.xml
[junit4] 2> 428254 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 428254 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 428254 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 428273 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 428282 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 428282 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 428283 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard0/cores
[junit4] 2> 428283 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 428284 INFO (coreLoadExecutor-1699-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 428284 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 428304 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 428331 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 428407 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 428413 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 428413 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 428413 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 428413 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard0/cores/collection1/data/]
[junit4] 2> 428414 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 428462 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 428462 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 428462 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 428462 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 428463 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1624550042, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 428464 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@7f9076fb[collection1] main]
[junit4] 2> 428464 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 428507 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 428605 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 428606 INFO (searcherExecutor-1700-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 428606 INFO (coreLoadExecutor-1699-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1590152101478006784
[junit4] 2> 428606 INFO (searcherExecutor-1700-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 428606 INFO (searcherExecutor-1700-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 428606 INFO (searcherExecutor-1700-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 428607 INFO (searcherExecutor-1700-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 428608 INFO (searcherExecutor-1700-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 428608 INFO (searcherExecutor-1700-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 428609 INFO (searcherExecutor-1700-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 428609 INFO (searcherExecutor-1700-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 428611 INFO (searcherExecutor-1700-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@7f9076fb[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 428764 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard1/cores/collection1
[junit4] 2> 428765 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T10:27:37+13:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 428766 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 428766 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 428766 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 428766 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1552c121{/cy_add/j,null,AVAILABLE}
[junit4] 2> 428766 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@764fa6e2{SSL,[ssl, http/1.1]}{127.0.0.1:37025}
[junit4] 2> 428766 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.Server Started @430406ms
[junit4] 2> 428766 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/cy_add/j, hostPort=37025, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard1/cores}
[junit4] 2> 428766 ERROR (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 428767 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 428767 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 428767 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 428767 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-20T22:26:58.520102Z
[junit4] 2> 428767 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard1/solr.xml
[junit4] 2> 428768 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 428769 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 428769 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 428786 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 428793 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 428793 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 428794 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard1/cores
[junit4] 2> 428794 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 428794 INFO (coreLoadExecutor-1710-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 428795 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 428826 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 428844 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 428927 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 428944 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 428944 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 428944 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 428944 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard1/cores/collection1/data/]
[junit4] 2> 428946 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 428988 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 428988 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 428988 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 428988 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 428989 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1624550042, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 428989 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@44a27101[collection1] main]
[junit4] 2> 428990 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 429041 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 429157 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 429157 INFO (coreLoadExecutor-1710-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1590152102055772160
[junit4] 2> 429158 INFO (searcherExecutor-1711-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 429159 INFO (searcherExecutor-1711-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 429159 INFO (searcherExecutor-1711-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 429159 INFO (searcherExecutor-1711-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 429178 INFO (searcherExecutor-1711-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 429178 INFO (searcherExecutor-1711-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 429179 INFO (searcherExecutor-1711-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 429179 INFO (searcherExecutor-1711-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 429182 INFO (searcherExecutor-1711-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 429199 INFO (searcherExecutor-1711-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@44a27101[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 429779 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.SolrTestCaseJ4 Writing core.properties file to /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard2/cores/collection1
[junit4] 2> 429781 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-22T10:27:37+13:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 429822 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 429822 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 429822 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 429823 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@225c3623{/cy_add/j,null,AVAILABLE}
[junit4] 2> 429823 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@779dcf71{SSL,[ssl, http/1.1]}{127.0.0.1:34397}
[junit4] 2> 429824 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.Server Started @431463ms
[junit4] 2> 429824 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/cy_add/j, hostPort=34397, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard2/cores}
[junit4] 2> 429824 ERROR (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 429824 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.3.0
[junit4] 2> 429824 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in standalone mode on port null
[junit4] 2> 429824 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 429824 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-20T22:26:59.577615Z
[junit4] 2> 429824 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard2/solr.xml
[junit4] 2> 429827 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 429827 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 429829 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 429850 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 429860 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 429860 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 429863 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.CorePropertiesLocator Found 1 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard2/cores
[junit4] 2> 429863 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.c.CorePropertiesLocator Cores are: [collection1]
[junit4] 2> 429863 INFO (coreLoadExecutor-1721-thread-1) [ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 429864 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.c.SolrResourceLoader [null] Added 2 libs to classloader, from paths: [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib, /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/lib/classes]
[junit4] 2> 429918 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 429939 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.s.IndexSchema [collection1] Schema name=test
[junit4] 2> 430050 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 430059 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.c.CoreContainer Creating SolrCore 'collection1' using configuration from configset /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1, trusted=true
[junit4] 2> 430059 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1' (registry 'solr.core.collection1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@23fdb93b
[junit4] 2> 430059 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 430059 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.c.SolrCore [[collection1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J0/temp/solr.search.facet.DistributedFacetSimpleRefinementLongTailTest_B52E943B300BC393-001/tempDir-001/shard2/cores/collection1/data/]
[junit4] 2> 430061 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=25, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0]
[junit4] 2> 430121 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 430121 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 430122 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 430122 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 430123 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=1624550042, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 430123 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.s.SolrIndexSearcher Opening [Searcher@262078b0[collection1] main]
[junit4] 2> 430124 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 430230 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 430347 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 430348 INFO (searcherExecutor-1722-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 430348 INFO (searcherExecutor-1722-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 430348 INFO (searcherExecutor-1722-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 430348 INFO (searcherExecutor-1722-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 430349 INFO (searcherExecutor-1722-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 430349 INFO (searcherExecutor-1722-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 430349 INFO (searcherExecutor-1722-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 430350 INFO (searcherExecutor-1722-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 430350 INFO (searcherExecutor-1722-thread-1-processing-x:collection1) [ x:collection1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 430351 INFO (searcherExecutor-1722-thread-1-processing-x:collection1) [ x:collection1] o.a.s.c.SolrCore [collection1] Registered new searcher Searcher@262078b0[collection1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 430351 INFO (coreLoadExecutor-1721-thread-1) [ x:collection1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1590152103307771904
[junit4] 2> 430854 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.SolrTestCaseJ4 ###Starting test
[junit4] 2> 430869 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[1 (1590152103849885696)]} 0 1
[junit4] 2> 430884 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[2 (1590152103865614336)]} 0 1
[junit4] 2> 430897 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[3 (1590152103878197248)]} 0 2
[junit4] 2> 430898 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[4 (1590152103881342976)]} 0 0
[junit4] 2> 430899 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[5 (1590152103882391552)]} 0 0
[junit4] 2> 430900 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[6 (1590152103883440128)]} 0 0
[junit4] 2> 430901 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[7 (1590152103884488704)]} 0 0
[junit4] 2> 430903 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[8 (1590152103884488704)]} 0 1
[junit4] 2> 430904 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[9 (1590152103887634432)]} 0 0
[junit4] 2> 430904 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[10 (1590152103887634432)]} 0 0
[junit4] 2> 430905 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[11 (1590152103888683008)]} 0 0
[junit4] 2> 430906 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[12 (1590152103889731584)]} 0 0
[junit4] 2> 430906 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[13 (1590152103889731584)]} 0 0
[junit4] 2> 430907 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[14 (1590152103890780160)]} 0 0
[junit4] 2> 430908 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[15 (1590152103891828736)]} 0 0
[junit4] 2> 430909 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[16 (1590152103892877312)]} 0 0
[junit4] 2> 430910 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[17 (1590152103893925888)]} 0 0
[junit4] 2> 430911 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[18 (1590152103893925888)]} 0 0
[junit4] 2> 430911 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[19 (1590152103894974464)]} 0 0
[junit4] 2> 430928 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[20 (1590152103912800256)]} 0 0
[junit4] 2> 430929 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[21 (1590152103913848832)]} 0 0
[junit4] 2> 430930 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[22 (1590152103914897408)]} 0 0
[junit4] 2> 430931 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[23 (1590152103915945984)]} 0 0
[junit4] 2> 430931 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[24 (1590152103915945984)]} 0 0
[junit4] 2> 430932 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[25 (1590152103916994560)]} 0 0
[junit4] 2> 430933 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[26 (1590152103918043136)]} 0 0
[junit4] 2> 430934 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[27 (1590152103918043136)]} 0 0
[junit4] 2> 430934 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[28 (1590152103919091712)]} 0 0
[junit4] 2> 430935 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[29 (1590152103920140288)]} 0 0
[junit4] 2> 430936 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[30 (1590152103920140288)]} 0 0
[junit4] 2> 430936 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[31 (1590152103921188864)]} 0 0
[junit4] 2> 430937 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[32 (1590152103922237440)]} 0 0
[junit4] 2> 430938 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[33 (1590152103923286016)]} 0 0
[junit4] 2> 430939 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[34 (1590152103923286016)]} 0 0
[junit4] 2> 430939 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[35 (1590152103924334592)]} 0 0
[junit4] 2> 430940 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[36 (1590152103925383168)]} 0 0
[junit4] 2> 430941 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[37 (1590152103926431744)]} 0 0
[junit4] 2> 430942 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[38 (1590152103927480320)]} 0 0
[junit4] 2> 430943 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[39 (1590152103927480320)]} 0 0
[junit4] 2> 430943 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[40 (1590152103928528896)]} 0 0
[junit4] 2> 430944 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[41 (1590152103929577472)]} 0 0
[junit4] 2> 430945 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[42 (1590152103930626048)]} 0 0
[junit4] 2> 430946 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[43 (1590152103931674624)]} 0 0
[junit4] 2> 430947 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[44 (1590152103932723200)]} 0 0
[junit4] 2> 430948 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[45 (1590152103932723200)]} 0 0
[junit4] 2> 430948 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[46 (1590152103933771776)]} 0 0
[junit4] 2> 430949 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[47 (1590152103934820352)]} 0 0
[junit4] 2> 430950 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[48 (1590152103935868928)]} 0 0
[junit4] 2> 430950 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[49 (1590152103935868928)]} 0 0
[junit4] 2> 430951 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[50 (1590152103936917504)]} 0 0
[junit4] 2> 430952 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[51 (1590152103937966080)]} 0 0
[junit4] 2> 430953 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[52 (1590152103937966080)]} 0 0
[junit4] 2> 430953 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[53 (1590152103939014656)]} 0 0
[junit4] 2> 430954 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[54 (1590152103940063232)]} 0 0
[junit4] 2> 430955 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[55 (1590152103940063232)]} 0 0
[junit4] 2> 430955 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[56 (1590152103941111808)]} 0 0
[junit4] 2> 430956 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[57 (1590152103942160384)]} 0 0
[junit4] 2> 430957 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[58 (1590152103943208960)]} 0 0
[junit4] 2> 430958 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[59 (1590152103944257536)]} 0 0
[junit4] 2> 430958 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[60 (1590152103944257536)]} 0 0
[junit4] 2> 430959 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[61 (1590152103945306112)]} 0 0
[junit4] 2> 430960 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[62 (1590152103946354688)]} 0 0
[junit4] 2> 430960 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[63 (1590152103946354688)]} 0 0
[junit4] 2> 430961 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[64 (1590152103947403264)]} 0 0
[junit4] 2> 430962 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[65 (1590152103948451840)]} 0 0
[junit4] 2> 430962 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[66 (1590152103948451840)]} 0 0
[junit4] 2> 430963 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[67 (1590152103949500416)]} 0 0
[junit4] 2> 430964 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[68 (1590152103950548992)]} 0 0
[junit4] 2> 430964 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[69 (1590152103950548992)]} 0 0
[junit4] 2> 430965 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[70 (1590152103951597568)]} 0 0
[junit4] 2> 430966 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[71 (1590152103951597568)]} 0 0
[junit4] 2> 430966 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[72 (1590152103952646144)]} 0 0
[junit4] 2> 430967 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[73 (1590152103953694720)]} 0 0
[junit4] 2> 430968 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[74 (1590152103953694720)]} 0 0
[junit4] 2> 430968 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[75 (1590152103954743296)]} 0 0
[junit4] 2> 430969 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[76 (1590152103955791872)]} 0 0
[junit4] 2> 430970 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[77 (1590152103955791872)]} 0 0
[junit4] 2> 430970 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[78 (1590152103956840448)]} 0 0
[junit4] 2> 430971 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[79 (1590152103957889024)]} 0 0
[junit4] 2> 430971 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[80 (1590152103957889024)]} 0 0
[junit4] 2> 430972 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[81 (1590152103958937600)]} 0 0
[junit4] 2> 430973 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[82 (1590152103958937600)]} 0 0
[junit4] 2> 430973 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[83 (1590152103959986176)]} 0 0
[junit4] 2> 430974 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[84 (1590152103961034752)]} 0 0
[junit4] 2> 430975 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[85 (1590152103961034752)]} 0 0
[junit4] 2> 430975 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[86 (1590152103962083328)]} 0 0
[junit4] 2> 430977 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[87 (1590152103964180480)]} 0 0
[junit4] 2> 430996 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[88 (1590152103983054848)]} 0 0
[junit4] 2> 430996 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[89 (1590152103984103424)]} 0 0
[junit4] 2> 430997 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[90 (1590152103985152000)]} 0 0
[junit4] 2> 430997 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[91 (1590152103985152000)]} 0 0
[junit4] 2> 430998 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[92 (1590152103986200576)]} 0 0
[junit4] 2> 430999 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[93 (1590152103986200576)]} 0 0
[junit4] 2> 430999 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[94 (1590152103987249152)]} 0 0
[junit4] 2> 431000 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[95 (1590152103987249152)]} 0 0
[junit4] 2> 431000 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[96 (1590152103988297728)]} 0 0
[junit4] 2> 431000 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[97 (1590152103988297728)]} 0 0
[junit4] 2> 431001 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[98 (1590152103989346304)]} 0 0
[junit4] 2> 431001 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[99 (1590152103989346304)]} 0 0
[junit4] 2> 431003 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[100 (1590152103991443456)]} 0 0
[junit4] 2> 431005 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[101 (1590152103993540608)]} 0 0
[junit4] 2> 431006 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[102 (1590152103994589184)]} 0 0
[junit4] 2> 431008 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[103 (1590152103996686336)]} 0 0
[junit4] 2> 431009 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[104 (1590152103997734912)]} 0 0
[junit4] 2> 431010 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[105 (1590152103997734912)]} 0 0
[junit4] 2> 431010 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[106 (1590152103998783488)]} 0 0
[junit4] 2> 431011 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[107 (1590152103999832064)]} 0 0
[junit4] 2> 431012 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[108 (1590152104000880640)]} 0 0
[junit4] 2> 431013 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[109 (1590152104001929216)]} 0 0
[junit4] 2> 431014 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[110 (1590152104002977792)]} 0 0
[junit4] 2> 431015 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[111 (1590152104004026368)]} 0 0
[junit4] 2> 431015 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[112 (1590152104004026368)]} 0 0
[junit4] 2> 431016 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[113 (1590152104005074944)]} 0 0
[junit4] 2> 431017 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[114 (1590152104005074944)]} 0 0
[junit4] 2> 431017 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[115 (1590152104006123520)]} 0 0
[junit4] 2> 431018 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[116 (1590152104006123520)]} 0 0
[junit4] 2> 431018 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[117 (1590152104007172096)]} 0 0
[junit4] 2> 431019 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[118 (1590152104008220672)]} 0 0
[junit4] 2> 431019 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[119 (1590152104008220672)]} 0 0
[junit4] 2> 431020 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[120 (1590152104009269248)]} 0 0
[junit4] 2> 431021 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[121 (1590152104009269248)]} 0 0
[junit4] 2> 431021 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[122 (1590152104010317824)]} 0 0
[junit4] 2> 431022 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[123 (1590152104011366400)]} 0 0
[junit4] 2> 431022 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[124 (1590152104011366400)]} 0 0
[junit4] 2> 431023 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[125 (1590152104011366400)]} 0 0
[junit4] 2> 431023 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[126 (1590152104012414976)]} 0 0
[junit4] 2> 431023 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[127 (1590152104012414976)]} 0 0
[junit4] 2> 431024 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[128 (1590152104013463552)]} 0 0
[junit4] 2> 431024 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[129 (1590152104013463552)]} 0 0
[junit4] 2> 431025 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[130 (1590152104014512128)]} 0 0
[junit4] 2> 431025 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[131 (1590152104014512128)]} 0 0
[junit4] 2> 431026 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[132 (1590152104015560704)]} 0 0
[junit4] 2> 431026 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[133 (1590152104015560704)]} 0 0
[junit4] 2> 431027 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[134 (1590152104015560704)]} 0 0
[junit4] 2> 431027 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[135 (1590152104016609280)]} 0 0
[junit4] 2> 431027 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[136 (1590152104016609280)]} 0 0
[junit4] 2> 431028 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[137 (1590152104017657856)]} 0 0
[junit4] 2> 431028 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[138 (1590152104017657856)]} 0 0
[junit4] 2> 431029 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[139 (1590152104018706432)]} 0 0
[junit4] 2> 431029 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[140 (1590152104018706432)]} 0 0
[junit4] 2> 431030 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[141 (1590152104018706432)]} 0 0
[junit4] 2> 431030 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[142 (1590152104019755008)]} 0 0
[junit4] 2> 431030 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[143 (1590152104019755008)]} 0 0
[junit4] 2> 431031 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[144 (1590152104020803584)]} 0 0
[junit4] 2> 431031 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[145 (1590152104020803584)]} 0 0
[junit4] 2> 431032 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[146 (1590152104021852160)]} 0 0
[junit4] 2> 431033 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[147 (1590152104022900736)]} 0 0
[junit4] 2> 431033 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[148 (1590152104022900736)]} 0 0
[junit4] 2> 431034 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[149 (1590152104023949312)]} 0 0
[junit4] 2> 431035 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[150 (1590152104024997888)]} 0 0
[junit4] 2> 431036 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[151 (1590152104026046464)]} 0 0
[junit4] 2> 431037 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[152 (1590152104027095040)]} 0 0
[junit4] 2> 431038 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[153 (1590152104028143616)]} 0 0
[junit4] 2> 431038 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[154 (1590152104028143616)]} 0 0
[junit4] 2> 431039 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[155 (1590152104029192192)]} 0 0
[junit4] 2> 431040 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[156 (1590152104029192192)]} 0 0
[junit4] 2> 431040 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[157 (1590152104030240768)]} 0 0
[junit4] 2> 431041 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[158 (1590152104031289344)]} 0 0
[junit4] 2> 431042 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[159 (1590152104032337920)]} 0 0
[junit4] 2> 431043 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[160 (1590152104032337920)]} 0 0
[junit4] 2> 431043 INFO (qtp338841225-7029) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[161 (1590152104033386496)]} 0 0
[junit4] 2> 431044 INFO (qtp1527732343-7046) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[162 (1590152104034435072)]} 0 0
[junit4] 2> 431045 INFO (qtp796745768-7012) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[163 (1590152104035483648)]} 0 0
[junit4] 2> 431045 INFO (qtp338841225-7031) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[164 (1590152104035483648)]} 0 0
[junit4] 2> 431046 INFO (qtp1527732343-7048) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[165 (1590152104036532224)]} 0 0
[junit4] 2> 431046 INFO (qtp796745768-7014) [ x:collection1] o.a.s.u.p.LogUpdateProcessorFactory [collection1] webapp=/cy_add/j path=/update params={wt=javabin&version=2}{add=[166 (1590152104036532224)]} 0 0
[junit4] 2> 431047 INFO (qtp338841225-70
[...truncated too long message...]
unit4] 2> 462721 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 462721 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@10f65887: rootName = null, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@2017b6c3
[junit4] 2> 462722 INFO (coreCloseExecutor-1733-thread-1) [ x:collection1] o.a.s.c.SolrCore [collection1] CLOSING SolrCore org.apache.solr.core.SolrCore@478d5f47
[junit4] 2> 462722 INFO (coreCloseExecutor-1733-thread-1) [ x:collection1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1, tag=1200447303
[junit4] 2> 462722 INFO (coreCloseExecutor-1733-thread-1) [ x:collection1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@74868159: rootName = null, domain = solr.core.collection1, service url = null, agent id = null] for registry solr.core.collection1 / com.codahale.metrics.MetricRegistry@1b4a3db5
[junit4] 2> 462737 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@225c3623{/cy_add/j,null,UNAVAILABLE}
[junit4] 2> 462737 INFO (TEST-DistributedFacetSimpleRefinementLongTailTest.test-seed#[B52E943B300BC393]) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 462739 INFO (SUITE-DistributedFacetSimpleRefinementLongTailTest-seed#[B52E943B300BC393]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Jan 20, 2018 10:27:32 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> Jan 20, 2018 10:27:52 PM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 1 thread leaked from SUITE scope at org.apache.solr.search.facet.DistributedFacetSimpleRefinementLongTailTest:
[junit4] 2> 1) Thread[id=7009, name=qtp796745768-7009, state=TIMED_WAITING, group=TGRP-DistributedFacetSimpleRefinementLongTailTest]
[junit4] 2> at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2192)
[junit4] 2> at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
[junit4] 2> Jan 20, 2018 10:27:52 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=7009, name=qtp796745768-7009, state=TIMED_WAITING, group=TGRP-DistributedFacetSimpleRefinementLongTailTest]
[junit4] 2> Jan 20, 2018 10:27:55 PM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> SEVERE: There are still zombie threads that couldn't be terminated:
[junit4] 2> 1) Thread[id=7009, name=qtp796745768-7009, state=TIMED_WAITING, group=TGRP-DistributedFacetSimpleRefinementLongTailTest]
[junit4] 2> at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] 2> at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] 2> at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2192)
[junit4] 2> at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] 2> at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] 2> at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {bar_s=FST50, multiDefault=PostingsFormat(name=Memory), foo_s=PostingsFormat(name=Memory), id=FST50}, docValues:{range_facet_l_dv=DocValuesFormat(name=Lucene70), _version_=DocValuesFormat(name=Direct), stat_i1=DocValuesFormat(name=Lucene70), intDefault=DocValuesFormat(name=Direct), id_i1=DocValuesFormat(name=Direct), range_facet_i_dv=DocValuesFormat(name=Memory), intDvoDefault=DocValuesFormat(name=Lucene70), range_facet_l=DocValuesFormat(name=Memory), timestamp=DocValuesFormat(name=Memory)}, maxPointsInLeafNode=1710, maxMBSortInHeap=7.930893815639342, sim=RandomSimilarity(queryNorm=true): {}, locale=en-MU, timezone=Atlantic/Faeroe
[junit4] 2> NOTE: Linux 4.13.0-26-generic amd64/Oracle Corporation 9.0.1 (64-bit)/cpus=8,threads=2,free=166573272,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [TestConfigOverlay, TestRawResponseWriter, TestSlowCompositeReaderWrapper, CoreAdminRequestStatusTest, TestUniqueKeyFieldResource, DocValuesMissingTest, CheckHdfsIndexTest, TestLRUStatsCache, CoreSorterTest, TestPHPSerializedResponseWriter, HLLSerializationTest, SynonymTokenizerTest, JavabinLoaderTest, TestSolrConfigHandlerConcurrent, CloudExitableDirectoryReaderTest, TestWriterPerf, TestFieldCollectionResource, TestTrieFacet, TestNoOpRegenerator, CdcrBidirectionalTest, TestRemoteStreaming, OutputWriterTest, TestHdfsUpdateLog, TestDistributedSearch, DocExpirationUpdateProcessorFactoryTest, TestDistribIDF, TestSchemaSimilarityResource, TestLuceneIndexBackCompat, TestSimDistributedQueue, SystemLogListenerTest, HdfsWriteToMultipleCollectionsTest, ChaosMonkeyNothingIsSafeTest, TestCustomDocTransformer, TestManagedSynonymGraphFilterFactory, TestConfigReload, DistributedFacetSimpleRefinementLongTailTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=DistributedFacetSimpleRefinementLongTailTest -Dtests.seed=B52E943B300BC393 -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=en-MU -Dtests.timezone=Atlantic/Faeroe -Dtests.asserts=true -Dtests.file.encoding=UTF-8
[junit4] ERROR 0.00s J0 | DistributedFacetSimpleRefinementLongTailTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 1 thread leaked from SUITE scope at org.apache.solr.search.facet.DistributedFacetSimpleRefinementLongTailTest:
[junit4] > 1) Thread[id=7009, name=qtp796745768-7009, state=TIMED_WAITING, group=TGRP-DistributedFacetSimpleRefinementLongTailTest]
[junit4] > at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] > at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] > at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2192)
[junit4] > at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
[junit4] > at __randomizedtesting.SeedInfo.seed([B52E943B300BC393]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=7009, name=qtp796745768-7009, state=TIMED_WAITING, group=TGRP-DistributedFacetSimpleRefinementLongTailTest]
[junit4] > at java.base@9.0.1/jdk.internal.misc.Unsafe.park(Native Method)
[junit4] > at java.base@9.0.1/java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:234)
[junit4] > at java.base@9.0.1/java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2192)
[junit4] > at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.reservedWait(ReservedThreadExecutor.java:308)
[junit4] > at app//org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:373)
[junit4] > at app//org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] > at app//org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.base@9.0.1/java.lang.Thread.run(Thread.java:844)
[junit4] > at __randomizedtesting.SeedInfo.seed([B52E943B300BC393]:0)
[junit4] Completed [130/767 (1!)] on J0 in 58.51s, 1 test, 2 errors <<< FAILURES!
[...truncated 42935 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_144) - Build # 1212
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1212/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseParallelGC
2 tests failed.
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Could not find collection:collection2
Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
at __randomizedtesting.SeedInfo.seed([E85A51084DDF657F:600E6ED2E3230887]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:915)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:612)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1737)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:934)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:970)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:984)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:993)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:968)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:829)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:879)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:890)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=17468, name=jetty-launcher-3870-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) 2) Thread[id=17470, name=jetty-launcher-3870-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=17468, name=jetty-launcher-3870-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
2) Thread[id=17470, name=jetty-launcher-3870-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
at __randomizedtesting.SeedInfo.seed([E85A51084DDF657F]:0)
Build Log:
[...truncated 12988 lines...]
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4] 2> 1235530 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[E85A51084DDF657F]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/init-core-data-001
[junit4] 2> 1235531 WARN (SUITE-FullSolrCloudDistribCmdsTest-seed#[E85A51084DDF657F]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=10 numCloses=10
[junit4] 2> 1235531 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[E85A51084DDF657F]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 1235533 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[E85A51084DDF657F]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776)
[junit4] 2> 1235533 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[E85A51084DDF657F]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /wb/l
[junit4] 2> 1235535 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1235536 INFO (Thread-4650) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1235536 INFO (Thread-4650) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1235537 ERROR (Thread-4650) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1235636 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.ZkTestServer start zk server on port:43319
[junit4] 2> 1235638 INFO (zkConnectionManagerCallback-2493-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1235641 INFO (zkConnectionManagerCallback-2495-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1235645 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1235647 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1235648 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1235649 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1235650 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1235651 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1235652 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1235652 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1235653 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1235654 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1235655 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractZkTestCase put /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1235656 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 1235741 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ????-??-??T??:??:??-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1235742 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1235742 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1235742 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1235743 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@41d505{/wb/l,null,AVAILABLE}
[junit4] 2> 1235743 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@74f718{HTTP/1.1,[http/1.1]}{127.0.0.1:41237}
[junit4] 2> 1235743 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.Server Started @1237285ms
[junit4] 2> 1235743 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/tempDir-001/control/data, hostContext=/wb/l, hostPort=41237, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/control-001/cores}
[junit4] 2> 1235743 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1235743 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1235743 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1235743 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1235743 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-21T05:46:32.550Z
[junit4] 2> 1235744 INFO (zkConnectionManagerCallback-2497-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1235745 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x161174104180002, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 1235745 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1235745 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/control-001/solr.xml
[junit4] 2> 1235747 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1235747 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1235748 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1235750 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43319/solr
[junit4] 2> 1235751 INFO (zkConnectionManagerCallback-2501-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1235752 INFO (zkConnectionManagerCallback-2503-thread-1-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1235781 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1235781 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:41237_wb%2Fl
[junit4] 2> 1235781 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.Overseer Overseer (id=99386234787856388-127.0.0.1:41237_wb%2Fl-n_0000000000) starting
[junit4] 2> 1235784 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:41237_wb%2Fl
[junit4] 2> 1235785 INFO (zkCallback-2502-thread-1-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1235847 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1235853 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1235853 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1235854 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/control-001/cores
[junit4] 2> 1235868 INFO (zkConnectionManagerCallback-2509-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1235869 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1235870 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43319/solr ready
[junit4] 2> 1235871 INFO (qtp15203938-13486) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:41237_wb%252Fl&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1235873 INFO (OverseerThreadFactory-5167-thread-1-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.a.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1235978 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1235979 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1236086 INFO (zkCallback-2502-thread-1-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1237031 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1237042 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1237125 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1237136 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 1237136 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1237137 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1237137 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1237139 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=60.1494140625, floorSegmentMB=1.2294921875, forceMergeDeletesPctAllowed=10.811039269288742, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1237141 WARN (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1237180 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1237180 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1237181 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1237181 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1237182 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=4.091796875, floorSegmentMB=1.7578125, forceMergeDeletesPctAllowed=25.41074357631232, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1237182 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@78aa60[control_collection_shard1_replica_n1] main]
[junit4] 2> 1237183 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1237183 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1237184 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1237184 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1590179758332706816
[junit4] 2> 1237186 INFO (searcherExecutor-5170-thread-1-processing-n:127.0.0.1:41237_wb%2Fl x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@78aa60[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1237189 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1237189 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1237189 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:41237/wb/l/control_collection_shard1_replica_n1/
[junit4] 2> 1237189 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1237189 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:41237/wb/l/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1237189 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1237195 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:41237/wb/l/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1237296 INFO (zkCallback-2502-thread-2-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1237345 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1237396 INFO (qtp15203938-13522) [n:127.0.0.1:41237_wb%2Fl c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1418
[junit4] 2> 1237398 INFO (qtp15203938-13486) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1237447 INFO (zkCallback-2502-thread-2-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1237874 INFO (OverseerCollectionConfigSetProcessor-99386234787856388-127.0.0.1:41237_wb%2Fl-n_0000000000) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1238398 INFO (qtp15203938-13486) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:41237_wb%252Fl&wt=javabin&version=2} status=0 QTime=2526
[junit4] 2> 1238403 INFO (zkConnectionManagerCallback-2513-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1238404 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1238405 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:43319/solr ready
[junit4] 2> 1238405 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1238405 INFO (qtp15203938-13521) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1238410 INFO (OverseerThreadFactory-5167-thread-2-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.a.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1238410 WARN (OverseerThreadFactory-5167-thread-2-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.a.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1238615 INFO (qtp15203938-13521) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1238615 INFO (qtp15203938-13521) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=2&wt=javabin&version=2} status=0 QTime=209
[junit4] 2> 1238710 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-1-001 of type NRT
[junit4] 2> 1238710 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ????-??-??T??:??:??-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1238711 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1238711 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1238711 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1238711 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@acf738{/wb/l,null,AVAILABLE}
[junit4] 2> 1238711 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7eba99{HTTP/1.1,[http/1.1]}{127.0.0.1:42631}
[junit4] 2> 1238711 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.Server Started @1240253ms
[junit4] 2> 1238711 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/wb/l, hostPort=42631, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-1-001/cores}
[junit4] 2> 1238712 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1238712 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1238712 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1238712 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1238712 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-21T05:46:35.519Z
[junit4] 2> 1238713 INFO (zkConnectionManagerCallback-2515-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1238714 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1238714 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-1-001/solr.xml
[junit4] 2> 1238716 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1238716 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1238717 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1238722 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43319/solr
[junit4] 2> 1238723 INFO (zkConnectionManagerCallback-2519-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1238724 INFO (zkConnectionManagerCallback-2521-thread-1-processing-n:127.0.0.1:42631_wb%2Fl) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1238727 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1238727 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1238728 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:42631_wb%2Fl
[junit4] 2> 1238728 INFO (zkCallback-2502-thread-2-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1238728 INFO (zkCallback-2520-thread-1-processing-n:127.0.0.1:42631_wb%2Fl) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1238729 INFO (zkCallback-2512-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1238802 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1238809 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1238809 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1238811 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-1-001/cores
[junit4] 2> 1238831 INFO (qtp15203938-13491) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:42631_wb%252Fl&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1238832 INFO (OverseerCollectionConfigSetProcessor-99386234787856388-127.0.0.1:41237_wb%2Fl-n_0000000000) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1238833 INFO (OverseerThreadFactory-5167-thread-3-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:42631_wb%2Fl for creating new replica
[junit4] 2> 1238834 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1238834 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1238936 INFO (zkCallback-2520-thread-1-processing-n:127.0.0.1:42631_wb%2Fl) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1239844 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1239853 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.IndexSchema [collection1_shard2_replica_n61] Schema name=test
[junit4] 2> 1239912 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1239920 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n61' using configuration from collection collection1, trusted=true
[junit4] 2> 1239920 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n61' (registry 'solr.core.collection1.shard2.replica_n61') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1239921 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1239921 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrCore [[collection1_shard2_replica_n61] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-1-001/cores/collection1_shard2_replica_n61], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-1-001/cores/collection1_shard2_replica_n61/data/]
[junit4] 2> 1239923 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=60.1494140625, floorSegmentMB=1.2294921875, forceMergeDeletesPctAllowed=10.811039269288742, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1239925 WARN (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1239966 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1239967 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1239967 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1239967 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1239968 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=4.091796875, floorSegmentMB=1.7578125, forceMergeDeletesPctAllowed=25.41074357631232, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1239968 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.SolrIndexSearcher Opening [Searcher@918a0d[collection1_shard2_replica_n61] main]
[junit4] 2> 1239969 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1239969 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1239970 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1239971 INFO (searcherExecutor-5181-thread-1-processing-n:127.0.0.1:42631_wb%2Fl x:collection1_shard2_replica_n61 s:shard2 c:collection1) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SolrCore [collection1_shard2_replica_n61] Registered new searcher Searcher@918a0d[collection1_shard2_replica_n61] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1239971 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1590179761255088128
[junit4] 2> 1239974 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1239974 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1239974 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:42631/wb/l/collection1_shard2_replica_n61/
[junit4] 2> 1239974 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1239974 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.SyncStrategy http://127.0.0.1:42631/wb/l/collection1_shard2_replica_n61/ has no replicas
[junit4] 2> 1239974 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1239975 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:42631/wb/l/collection1_shard2_replica_n61/ shard2
[junit4] 2> 1240076 INFO (zkCallback-2520-thread-1-processing-n:127.0.0.1:42631_wb%2Fl) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 1240126 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1240127 INFO (qtp7673607-13538) [n:127.0.0.1:42631_wb%2Fl c:collection1 s:shard2 x:collection1_shard2_replica_n61] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n61&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1293
[junit4] 2> 1240128 INFO (qtp15203938-13491) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:42631_wb%252Fl&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1297
[junit4] 2> 1240205 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-2-001 of type NRT
[junit4] 2> 1240206 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ????-??-??T??:??:??-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1240206 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1240206 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1240206 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session Scavenging every 600000ms
[junit4] 2> 1240206 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1403b9f{/wb/l,null,AVAILABLE}
[junit4] 2> 1240207 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@9f489e{HTTP/1.1,[http/1.1]}{127.0.0.1:44677}
[junit4] 2> 1240207 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.Server Started @1241749ms
[junit4] 2> 1240207 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/wb/l, hostPort=44677, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-2-001/cores}
[junit4] 2> 1240207 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1240207 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1240207 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1240207 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1240207 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-21T05:46:37.014Z
[junit4] 2> 1240208 INFO (zkConnectionManagerCallback-2525-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1240209 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1240209 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-2-001/solr.xml
[junit4] 2> 1240211 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1240211 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1240212 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1240214 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43319/solr
[junit4] 2> 1240215 INFO (zkConnectionManagerCallback-2529-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1240216 INFO (zkConnectionManagerCallback-2531-thread-1-processing-n:127.0.0.1:44677_wb%2Fl) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1240218 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1240219 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1240220 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:44677_wb%2Fl
[junit4] 2> 1240220 INFO (zkCallback-2520-thread-1-processing-n:127.0.0.1:42631_wb%2Fl) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1240220 INFO (zkCallback-2512-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1240221 INFO (zkCallback-2530-thread-1-processing-n:127.0.0.1:44677_wb%2Fl) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1240221 INFO (zkCallback-2502-thread-2-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1240304 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1240312 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1240312 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1240313 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-2-001/cores
[junit4] 2> 1240321 INFO (zkCallback-2520-thread-1-processing-n:127.0.0.1:42631_wb%2Fl) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1240345 INFO (qtp15203938-13521) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:44677_wb%252Fl&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1240347 INFO (OverseerCollectionConfigSetProcessor-99386234787856388-127.0.0.1:41237_wb%2Fl-n_0000000000) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1240347 INFO (OverseerThreadFactory-5167-thread-4-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:44677_wb%2Fl for creating new replica
[junit4] 2> 1240348 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1240348 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1240450 INFO (zkCallback-2520-thread-1-processing-n:127.0.0.1:42631_wb%2Fl) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1240450 INFO (zkCallback-2530-thread-1-processing-n:127.0.0.1:44677_wb%2Fl) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1241392 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1241408 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.IndexSchema [collection1_shard3_replica_n63] Schema name=test
[junit4] 2> 1241463 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1241470 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard3_replica_n63' using configuration from collection collection1, trusted=true
[junit4] 2> 1241470 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard3.replica_n63' (registry 'solr.core.collection1.shard3.replica_n63') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1241471 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1241471 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrCore [[collection1_shard3_replica_n63] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-2-001/cores/collection1_shard3_replica_n63], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-2-001/cores/collection1_shard3_replica_n63/data/]
[junit4] 2> 1241472 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=60.1494140625, floorSegmentMB=1.2294921875, forceMergeDeletesPctAllowed=10.811039269288742, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1241474 WARN (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1241508 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1241508 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1241509 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1241509 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1241511 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=28, maxMergeAtOnceExplicit=12, maxMergedSegmentMB=4.091796875, floorSegmentMB=1.7578125, forceMergeDeletesPctAllowed=25.41074357631232, segmentsPerTier=44.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0
[junit4] 2> 1241511 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.SolrIndexSearcher Opening [Searcher@6af371[collection1_shard3_replica_n63] main]
[junit4] 2> 1241512 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1241512 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1241512 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 1241512 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1590179762870943744
[junit4] 2> 1241513 INFO (searcherExecutor-5192-thread-1-processing-n:127.0.0.1:44677_wb%2Fl x:collection1_shard3_replica_n63 s:shard3 c:collection1) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SolrCore [collection1_shard3_replica_n63] Registered new searcher Searcher@6af371[collection1_shard3_replica_n63] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1241515 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1241515 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1241515 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:44677/wb/l/collection1_shard3_replica_n63/
[junit4] 2> 1241515 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1241515 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.SyncStrategy http://127.0.0.1:44677/wb/l/collection1_shard3_replica_n63/ has no replicas
[junit4] 2> 1241515 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1241516 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:44677/wb/l/collection1_shard3_replica_n63/ shard3
[junit4] 2> 1241617 INFO (zkCallback-2520-thread-1-processing-n:127.0.0.1:42631_wb%2Fl) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1241617 INFO (zkCallback-2530-thread-1-processing-n:127.0.0.1:44677_wb%2Fl) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1241666 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1241668 INFO (qtp25301523-13570) [n:127.0.0.1:44677_wb%2Fl c:collection1 s:shard3 x:collection1_shard3_replica_n63] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n63&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1320
[junit4] 2> 1241670 INFO (qtp15203938-13521) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:44677_wb%252Fl&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2} status=0 QTime=1324
[junit4] 2> 1241757 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-3-001 of type NRT
[junit4] 2> 1241758 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: ????-??-??T??:??:??-08:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 1241759 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 1241759 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 1241759 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 1241759 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@b865ae{/wb/l,null,AVAILABLE}
[junit4] 2> 1241760 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@188e2bb{HTTP/1.1,[http/1.1]}{127.0.0.1:38613}
[junit4] 2> 1241760 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.e.j.s.Server Started @1243302ms
[junit4] 2> 1241760 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/tempDir-001/jetty3, solrconfig=solrconfig.xml, hostContext=/wb/l, hostPort=38613, coreRootDirectory=/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-3-001/cores}
[junit4] 2> 1241760 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1241760 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 1241760 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1241760 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 1241760 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-21T05:46:38.567Z
[junit4] 2> 1241761 INFO (zkConnectionManagerCallback-2535-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1241762 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1241762 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-3-001/solr.xml
[junit4] 2> 1241764 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverWorkLoopDelay is ignored
[junit4] 2> 1241764 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig Configuration parameter autoReplicaFailoverBadNodeExpiration is ignored
[junit4] 2> 1241764 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1241767 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:43319/solr
[junit4] 2> 1241767 INFO (zkConnectionManagerCallback-2539-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1241768 INFO (zkCallback-2520-thread-1-processing-n:127.0.0.1:42631_wb%2Fl) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1241768 INFO (zkCallback-2530-thread-1-processing-n:127.0.0.1:44677_wb%2Fl) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [3])
[junit4] 2> 1241769 INFO (zkConnectionManagerCallback-2541-thread-1-processing-n:127.0.0.1:38613_wb%2Fl) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 1241771 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1241771 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1241772 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38613_wb%2Fl
[junit4] 2> 1241772 INFO (zkCallback-2520-thread-1-processing-n:127.0.0.1:42631_wb%2Fl) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1241772 INFO (zkCallback-2502-thread-2-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1241772 INFO (zkCallback-2530-thread-1-processing-n:127.0.0.1:44677_wb%2Fl) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1241772 INFO (zkCallback-2512-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1241773 INFO (zkCallback-2540-thread-1-processing-n:127.0.0.1:38613_wb%2Fl) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1241869 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1241876 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1241876 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1241877 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[E85A51084DDF657F]) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-3-001/cores
[junit4] 2> 1241908 INFO (qtp26464423-13601) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:38613_wb%252Fl&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1241910 INFO (OverseerCollectionConfigSetProcessor-99386234787856388-127.0.0.1:41237_wb%2Fl-n_0000000000) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1241910 INFO (OverseerThreadFactory-5167-thread-5-processing-n:127.0.0.1:41237_wb%2Fl) [n:127.0.0.1:41237_wb%2Fl ] o.a.s.c.a.c.AddReplicaCmd Node Identified 127.0.0.1:38613_wb%2Fl for creating new replica
[junit4] 2> 1241912 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n65&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1241912 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1242015 INFO (zkCallback-2530-thread-1-processing-n:127.0.0.1:44677_wb%2Fl) [n:127.0.0.1:44677_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1242015 INFO (zkCallback-2540-thread-1-processing-n:127.0.0.1:38613_wb%2Fl) [n:127.0.0.1:38613_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1242015 INFO (zkCallback-2520-thread-1-processing-n:127.0.0.1:42631_wb%2Fl) [n:127.0.0.1:42631_wb%2Fl ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [4])
[junit4] 2> 1242987 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 1242995 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.s.IndexSchema [collection1_shard1_replica_n65] Schema name=test
[junit4] 2> 1243044 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1243051 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n65' using configuration from collection collection1, trusted=true
[junit4] 2> 1243052 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n65' (registry 'solr.core.collection1.shard1.replica_n65') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@fa4772
[junit4] 2> 1243052 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1243052 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.SolrCore [[collection1_shard1_replica_n65] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-3-001/cores/collection1_shard1_replica_n65], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/../../../../../../../../../home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J2/temp/solr.cloud.FullSolrCloudDistribCmdsTest_E85A51084DDF657F-001/shard-3-001/cores/collection1_shard1_replica_n65/data/]
[junit4] 2> 1243053 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=37, maxMergeAtOnceExplicit=48, maxMergedSegmentMB=60.1494140625, floorSegmentMB=1.2294921875, forceMergeDeletesPctAllowed=10.811039269288742, segmentsPerTier=41.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1243055 WARN (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1243079 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1243079 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1243080 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1243080 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_shard1_replica_n65] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1243081 INFO (qtp26464423-13627) [n:127.0.0.1:38613_wb%2Fl c:collection1 s:shard1 x:collection1_sha
[...truncated too long message...]
.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> Jan 21, 2018 5:56:11 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: All leaked threads terminated.
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {}, docValues:{}, maxPointsInLeafNode=1848, maxMBSortInHeap=5.628196505420811, sim=RandomSimilarity(queryNorm=true): {}, locale=es-DO, timezone=America/Guadeloupe
[junit4] 2> NOTE: Linux 4.13.0-26-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=169384992,total=525074432
[junit4] 2> NOTE: All tests run in this JVM: [HttpPartitionTest, CoreMergeIndexesAdminHandlerTest, TestElisionMultitermQuery, TestFieldCacheVsDocValues, AddReplicaTest, OverseerRolesTest, TestShortCircuitedRequests, DOMUtilTest, AutoAddReplicasIntegrationTest, TestFreeTextSuggestions, BasicFunctionalityTest, TestTriggerIntegration, BigEndianAscendingWordDeserializerTest, TestInPlaceUpdatesDistrib, TestReversedWildcardFilterFactory, SolrShardReporterTest, TestGenericDistributedQueue, DistributedFacetPivotSmallTest, ShardRoutingCustomTest, SoftAutoCommitTest, TestLockTree, DistributedIntervalFacetingTest, TestInitQParser, BadComponentTest, TestClusterProperties, TestDynamicFieldCollectionResource, TestSolrCloudWithHadoopAuthPlugin, ScriptEngineTest, PeerSyncTest, TestRecovery, ZkControllerTest, TestObjectReleaseTracker, SolrCoreTest, SimplePostToolTest, XsltUpdateRequestHandlerTest, PrimUtilsTest, SampleTest, OverriddenZkACLAndCredentialsProvidersTest, HdfsNNFailoverTest, CollectionReloadTest, TestDistributedStatsComponentCardinality, TimeRoutedAliasUpdateProcessorTest, RulesTest, RequiredFieldsTest, TestQueryWrapperFilter, ChaosMonkeySafeLeaderTest, TestLeaderElectionWithEmptyReplica, TestAnalyzeInfixSuggestions, TestStandardQParsers, TestLegacyField, TestCloudPseudoReturnFields, CachingDirectoryFactoryTest, SolrInfoBeanTest, TestPivotHelperCode, TestRandomFlRTGCloud, TestCollectionAPI, SliceStateTest, TestQueryUtils, QueryElevationComponentTest, TestOverriddenPrefixQueryForCustomFieldType, VersionInfoTest, TestComplexPhraseQParserPlugin, TestScoreJoinQPNoScore, DistributedQueryComponentOptimizationTest, DistributedMLTComponentTest, SortByFunctionTest, QueryParsingTest, TestReload, TestFuzzyAnalyzedSuggestions, CurrencyRangeFacetCloudTest, TestJavabinTupleStreamParser, TestSha256AuthenticationProvider, TestNRTOpen, BlockDirectoryTest, AlternateDirectoryTest, HdfsLockFactoryTest, SolrMetricManagerTest, TestAuthorizationFramework, TestSurroundQueryParser, AddBlockUpdateTest, StressHdfsTest, LeaderFailureAfterFreshStartTest, TestSchemaNameResource, TestSystemCollAutoCreate, TestLRUCache, BlockJoinFacetDistribTest, ClassificationUpdateProcessorTest, JvmMetricsTest, LoggingHandlerTest, SearchHandlerTest, DeleteShardTest, DeleteLastCustomShardedReplicaTest, TestZkChroot, HttpTriggerListenerTest, OverseerTest, ReplaceNodeTest, TestSolrCloudSnapshots, TestExportWriter, TestEmbeddedSolrServerAdminHandler, TestSubQueryTransformerDistrib, BasicAuthIntegrationTest, TestRequestForwarding, SolrGangliaReporterTest, CloudMLTQParserTest, VMParamsZkACLAndCredentialsProvidersTest, TestBM25SimilarityFactory, TestLocalFSCloudBackupRestore, HdfsCollectionsAPIDistributedZkTest, BadCopyFieldTest, DirectUpdateHandlerOptimizeTest, TestDocBasedVersionConstraints, PolyFieldTest, SOLR749Test, TestBulkSchemaConcurrent, TestConfigsApi, PrimitiveFieldTypeTest, CSVRequestHandlerTest, HLLUtilTest, TestComputePlanAction, TestNodeLostTrigger, DirectoryFactoryTest, TestSweetSpotSimilarityFactory, TestXIncludeConfig, SchemaApiFailureTest, TestJettySolrRunner, ResourceLoaderTest, RecoveryZkTest, TestRandomFaceting, LeaderElectionTest, TestRandomDVFaceting, DistributedSpellCheckComponentTest, TestStressVersions, TestSolr4Spatial, TestGroupingSearch, TestBadConfig, DistributedQueryElevationComponentTest, SuggesterFSTTest, TestTrie, SuggesterWFSTTest, SchemaVersionSpecificBehaviorTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestRemoteStreaming, TestQueryTypes, XmlUpdateRequestHandlerTest, DocumentBuilderTest, TestIndexingPerformance, FieldAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, UpdateRequestProcessorFactoryTest, TestAnalyzedSuggestions, TestPartialUpdateDeduplication, TestQuerySenderListener, TestSolrIndexConfig, TestStressRecovery, TestHighlightDedupGrouping, TestTolerantSearch, TestEmbeddedSolrServerConstructors, ConnectionReuseTest, AssignBackwardCompatibilityTest, CollectionStateFormat2Test, DeleteReplicaTest, DistribCursorPagingTest, DocValuesNotIndexedTest, LeaderElectionContextKeyTest, LeaderFailoverAfterPartitionTest, MultiThreadedOCPTest, SSLMigrationTest, SaslZkACLProviderTest, SolrXmlInZkTest, TestCloudDeleteByQuery, TestCloudInspectUtil, TestCloudJSONFacetJoinDomain, TestConfigSetsAPI, TestSizeLimitedDistributedMap, TestSkipOverseerOperations, TestSolrCloudWithSecureImpersonation]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestSolrCloudWithSecureImpersonation -Dtests.seed=E85A51084DDF657F -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=es-DO -Dtests.timezone=America/Guadeloupe -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | TestSolrCloudWithSecureImpersonation (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] > 1) Thread[id=17468, name=jetty-launcher-3870-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > 2) Thread[id=17470, name=jetty-launcher-3870-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] > at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] > at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] > at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] > at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] > at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] > at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] > at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] > at __randomizedtesting.SeedInfo.seed([E85A51084DDF657F]:0)
[junit4] Completed [556/767 (2!)] on J1 in 36.62s, 12 tests, 1 error <<< FAILURES!
[...truncated 44690 lines...]
[JENKINS] Lucene-Solr-7.x-Linux (32bit/jdk1.8.0_144) - Build # 1211
- Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-Linux/1211/
Java: 32bit/jdk1.8.0_144 -server -XX:+UseSerialGC
2 tests failed.
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
Error Message:
2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation: 1) Thread[id=22760, name=jetty-launcher-4388-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505) 2) Thread[id=22756, name=jetty-launcher-4388-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037) at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328) at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277) at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323) at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105) at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279) at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41) at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244) at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44) at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61) at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
1) Thread[id=22760, name=jetty-launcher-4388-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
2) Thread[id=22756, name=jetty-launcher-4388-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
at __randomizedtesting.SeedInfo.seed([A00A40A63F260ADE]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.uninverting.TestNumericTerms64
Error Message:
The test or suite printed 13416 bytes to stdout and stderr, even though the limit was set to 8192 bytes. Increase the limit with @Limit, ignore it completely with @SuppressSysoutChecks or run with -Dtests.verbose=true
Stack Trace:
java.lang.AssertionError: The test or suite printed 13416 bytes to stdout and stderr, even though the limit was set to 8192 bytes. Increase the limit with @Limit, ignore it completely with @SuppressSysoutChecks or run with -Dtests.verbose=true
at __randomizedtesting.SeedInfo.seed([A00A40A63F260ADE]:0)
at org.apache.lucene.util.TestRuleLimitSysouts.afterIfSuccessful(TestRuleLimitSysouts.java:211)
at com.carrotsearch.randomizedtesting.rules.TestRuleAdapter$1.afterIfSuccessful(TestRuleAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:37)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 13465 lines...]
[junit4] Suite: org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation
[junit4] 2> Creating dataDir: /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_A00A40A63F260ADE-001/init-core-data-001
[junit4] 2> 2561198 WARN (SUITE-TestSolrCloudWithSecureImpersonation-seed#[A00A40A63F260ADE]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=104 numCloses=104
[junit4] 2> 2561198 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[A00A40A63F260ADE]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 2561199 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[A00A40A63F260ADE]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (true) via: @org.apache.solr.util.RandomizeSSL(reason=, ssl=NaN, value=NaN, clientAuth=NaN)
[junit4] 2> 2561199 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[A00A40A63F260ADE]-worker) [ ] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom
[junit4] 2> 2561211 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[A00A40A63F260ADE]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_A00A40A63F260ADE-001/tempDir-001
[junit4] 2> 2561212 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[A00A40A63F260ADE]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 2561212 INFO (Thread-5867) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 2561212 INFO (Thread-5867) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 2561213 ERROR (Thread-5867) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2561312 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[A00A40A63F260ADE]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:42759
[junit4] 2> 2561313 INFO (zkConnectionManagerCallback-4391-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2561315 INFO (jetty-launcher-4388-thread-2) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2561315 INFO (jetty-launcher-4388-thread-1) [ ] o.e.j.s.Server jetty-9.4.8.v20171121, build timestamp: 2017-11-21T23:27:37+02:00, git hash: 82b8fb23f757335bb3329d540ce37a2a2615f0a8
[junit4] 2> 2561315 INFO (jetty-launcher-4388-thread-2) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2561315 INFO (jetty-launcher-4388-thread-2) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-2) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-1) [ ] o.e.j.s.session DefaultSessionIdManager workerName=node0
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-1) [ ] o.e.j.s.session No SessionScavenger set, using defaults
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-1) [ ] o.e.j.s.session Scavenging every 660000ms
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@13aa35a{/solr,null,AVAILABLE}
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@1976d70{/solr,null,AVAILABLE}
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@c1a806{HTTP/1.1,[http/1.1]}{127.0.0.1:38447}
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@168ff13{HTTP/1.1,[http/1.1]}{127.0.0.1:37157}
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-2) [ ] o.e.j.s.Server Started @2563251ms
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-1) [ ] o.e.j.s.Server Started @2563251ms
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=38447}
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=37157}
[junit4] 2> 2561316 ERROR (jetty-launcher-4388-thread-2) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2561316 ERROR (jetty-launcher-4388-thread-1) [ ] o.a.s.u.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 2561316 INFO (jetty-launcher-4388-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 2561317 INFO (jetty-launcher-4388-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.3.0
[junit4] 2> 2561317 INFO (jetty-launcher-4388-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2561317 INFO (jetty-launcher-4388-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 2561317 INFO (jetty-launcher-4388-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2561317 INFO (jetty-launcher-4388-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null
[junit4] 2> 2561317 INFO (jetty-launcher-4388-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-21T02:17:22.583Z
[junit4] 2> 2561317 INFO (jetty-launcher-4388-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2018-01-21T02:17:22.583Z
[junit4] 2> 2561318 INFO (zkConnectionManagerCallback-4394-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2561318 INFO (zkConnectionManagerCallback-4395-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2561318 INFO (jetty-launcher-4388-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2561318 INFO (jetty-launcher-4388-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 2561323 INFO (jetty-launcher-4388-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42759/solr
[junit4] 2> 2561323 INFO (jetty-launcher-4388-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:42759/solr
[junit4] 2> 2561324 INFO (zkConnectionManagerCallback-4400-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2561324 INFO (zkConnectionManagerCallback-4403-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2561325 INFO (zkConnectionManagerCallback-4405-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2561325 INFO (zkConnectionManagerCallback-4407-thread-1-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2561355 INFO (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2561355 INFO (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:37157_solr
[junit4] 2> 2561355 INFO (jetty-launcher-4388-thread-2) [n:127.0.0.1:38447_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 2561355 INFO (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.c.Overseer Overseer (id=99385412319903749-127.0.0.1:37157_solr-n_0000000000) starting
[junit4] 2> 2561356 INFO (jetty-launcher-4388-thread-2) [n:127.0.0.1:38447_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:38447_solr
[junit4] 2> 2561356 INFO (zkCallback-4406-thread-1-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2561356 INFO (zkCallback-4404-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 2561359 INFO (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:37157_solr
[junit4] 2> 2561359 INFO (OverseerStateUpdate-99385412319903749-127.0.0.1:37157_solr-n_0000000000) [n:127.0.0.1:37157_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2561363 INFO (zkCallback-4406-thread-1-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 2561409 INFO (jetty-launcher-4388-thread-2) [n:127.0.0.1:38447_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 2561409 WARN (jetty-launcher-4388-thread-2) [n:127.0.0.1:38447_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 2561409 INFO (jetty-launcher-4388-thread-2) [n:127.0.0.1:38447_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 2561410 INFO (jetty-launcher-4388-thread-2) [n:127.0.0.1:38447_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 2561411 INFO (jetty-launcher-4388-thread-2-EventThread) [n:127.0.0.1:38447_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 2561494 INFO (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.c.CoreContainer Initializing authentication plugin: org.apache.solr.security.HttpParamDelegationTokenPlugin
[junit4] 2> 2561495 WARN (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 2561495 INFO (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.s.KerberosPlugin Params: {solr.kerberos.impersonator.user.noGroups.hosts=*, solr.kerberos.impersonator.user.bogusGroup.groups=__some_bogus_group, token.valid=30, cookie.domain=127.0.0.1, solr.kerberos.impersonator.user.anyHostAnyUser.groups=*, solr.kerberos.impersonator.user.bogusGroup.hosts=*, solr.kerberos.impersonator.user.anyHostAnyUser.hosts=*, token.validity=36000, solr.kerberos.impersonator.user.noHosts.groups=*, type=kerberos, solr.kerberos.impersonator.user.localHostAnyGroup.groups=*, delegation-token.token-kind=solr-dt, solr.kerberos.impersonator.user.wrongHost.hosts=1.1.1.1.1.1, cookie.path=/, zk-dt-secret-manager.znodeWorkingPath=solr/security/zkdtsm, solr.kerberos.impersonator.user.localHostAnyGroup.hosts=localhost.localdomain,localhost,127.0.0.1, signer.secret.provider.zookeeper.path=/token, solr.kerberos.impersonator.user.anyHostUsersGroup.groups=jenkins, zk-dt-secret-manager.enable=true, solr.kerberos.impersonator.user.wrongHost.groups=*, kerberos.name.rules=DEFAULT, signer.secret.provider=zookeeper, solr.kerberos.impersonator.user.anyHostUsersGroup.hosts=*}
[junit4] 2> 2561495 INFO (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.c.f.i.CuratorFrameworkImpl Starting
[junit4] 2> 2561496 INFO (jetty-launcher-4388-thread-1-EventThread) [n:127.0.0.1:37157_solr ] o.a.c.f.s.ConnectionStateManager State change: CONNECTED
[junit4] 2> 2561503 WARN (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 2561530 INFO (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37157.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e9dff
[junit4] 2> 2561536 INFO (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37157.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e9dff
[junit4] 2> 2561536 INFO (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_37157.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e9dff
[junit4] 2> 2561537 INFO (jetty-launcher-4388-thread-1) [n:127.0.0.1:37157_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_A00A40A63F260ADE-001/tempDir-001/node1/.
[junit4] 2> 2562424 WARN (jetty-launcher-4388-thread-2) [n:127.0.0.1:38447_solr ] o.a.s.c.s.i.Krb5HttpClientBuilder org.apache.solr.client.solrj.impl.Krb5HttpClientBuilder is configured without specifying system property 'java.security.auth.login.config'
[junit4] 2> 2562461 INFO (jetty-launcher-4388-thread-2) [n:127.0.0.1:38447_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38447.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e9dff
[junit4] 2> 2562469 INFO (jetty-launcher-4388-thread-2) [n:127.0.0.1:38447_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38447.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e9dff
[junit4] 2> 2562469 INFO (jetty-launcher-4388-thread-2) [n:127.0.0.1:38447_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38447.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e9dff
[junit4] 2> 2562470 INFO (jetty-launcher-4388-thread-2) [n:127.0.0.1:38447_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_A00A40A63F260ADE-001/tempDir-001/node2/.
[junit4] 2> 2562486 INFO (zkConnectionManagerCallback-4413-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2562499 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNullProxyUser
[junit4] 2> 2562499 INFO (qtp4786941-22710) [ ] o.a.s.s.SolrDispatchFilter Error authenticating
[junit4] 2> java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:449)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2562500 WARN (qtp4786941-22710) [ ] o.e.j.s.HttpChannel /solr/admin/collections
[junit4] 2> org.apache.solr.common.SolrException: Error during request authentication,
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:455)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:349)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:326)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.apache.solr.client.solrj.embedded.JettySolrRunner$DebugFilter.doFilter(JettySolrRunner.java:139)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1637)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:533)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:1595)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextHandle(ScopedHandler.java:188)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1253)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:168)
[junit4] 2> at org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:473)
[junit4] 2> at org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:1564)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.nextScope(ScopedHandler.java:166)
[junit4] 2> at org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1155)
[junit4] 2> at org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
[junit4] 2> at org.eclipse.jetty.server.handler.gzip.GzipHandler.handle(GzipHandler.java:527)
[junit4] 2> at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:132)
[junit4] 2> at org.eclipse.jetty.server.Server.handle(Server.java:530)
[junit4] 2> at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:347)
[junit4] 2> at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:256)
[junit4] 2> at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:279)
[junit4] 2> at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:102)
[junit4] 2> at org.eclipse.jetty.io.ChannelEndPoint$2.run(ChannelEndPoint.java:124)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:247)
[junit4] 2> at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.produce(EatWhatYouKill.java:140)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:708)
[junit4] 2> at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> Caused by: java.lang.IllegalArgumentException: userName is NULL, empty or contains a '&'
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.checkForIllegalArgument(AuthToken.java:87)
[junit4] 2> at org.apache.hadoop.security.authentication.util.AuthToken.<init>(AuthToken.java:70)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationToken.<init>(AuthenticationToken.java:58)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamDelegationTokenAuthenticationHandler$HttpParamAuthenticationHandler.authenticate(HttpParamDelegationTokenPlugin.java:213)
[junit4] 2> at org.apache.hadoop.security.token.delegation.web.DelegationTokenAuthenticationHandler.authenticate(DelegationTokenAuthenticationHandler.java:348)
[junit4] 2> at org.apache.solr.security.RequestContinuesRecorderAuthenticationHandler.authenticate(RequestContinuesRecorderAuthenticationHandler.java:69)
[junit4] 2> at org.apache.hadoop.security.authentication.server.AuthenticationFilter.doFilter(AuthenticationFilter.java:518)
[junit4] 2> at org.apache.solr.security.DelegationTokenKerberosFilter.doFilter(DelegationTokenKerberosFilter.java:134)
[junit4] 2> at org.apache.solr.security.HttpParamDelegationTokenPlugin$HttpParamToRequestFilter.doFilter(HttpParamDelegationTokenPlugin.java:245)
[junit4] 2> at org.apache.solr.security.KerberosPlugin.doAuthenticate(KerberosPlugin.java:243)
[junit4] 2> at org.apache.solr.servlet.SolrDispatchFilter.authenticateRequest(SolrDispatchFilter.java:449)
[junit4] 2> ... 29 more
[junit4] 2> 2562501 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNullProxyUser-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNullProxyUser
[junit4] 2> 2562512 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidRemote
[junit4] 2> 2562519 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1516537043779&s=Q1rVFvlOZS8bMSF44/6gdAttitw="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:23 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:23 GMT
[junit4] 2> 2562519 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidRemote-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidRemote
[junit4] 2> 2562531 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidProxyUser
[junit4] 2> 2562534 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bar&p=bar&t=test&e=1516537043797&s=Nes4PwvHvcUvmBl3nXL0p/zVodk="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:23 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:23 GMT
[junit4] 2> 2562534 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidProxyUser-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidProxyUser
[junit4] 2> 2562548 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateHost
[junit4] 2> 2562548 INFO (qtp4786941-22720) [n:127.0.0.1:37157_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2562548 INFO (qtp4786941-22720) [n:127.0.0.1:37157_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2562549 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1516537043814&s=LBYYtOG6aLErojrXt4VQi3UNiTQ="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:23 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:23 GMT
[junit4] 2> 2562549 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateHost-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateHost
[junit4] 2> 2562560 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateGroup
[junit4] 2> 2562573 INFO (qtp4786941-22718) [n:127.0.0.1:37157_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=jenkins&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2562573 INFO (qtp4786941-22718) [n:127.0.0.1:37157_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=jenkins&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2562573 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostUsersGroup&p=anyHostUsersGroup&t=test&e=1516537043826&s=kM1nv23epbbp7w0Z8QdSQeAfhwI="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:23 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:23 GMT
[junit4] 2> 2562573 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateGroup-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateGroup
[junit4] 2> 2562585 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testForwarding
[junit4] 2> 2562586 INFO (zkConnectionManagerCallback-4416-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2562703 INFO (zkConnectionManagerCallback-4419-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2562704 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[A00A40A63F260ADE]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 2562704 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[A00A40A63F260ADE]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:42759/solr ready
[junit4] 2> 2562705 INFO (qtp4786941-22718) [n:127.0.0.1:37157_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2562706 INFO (OverseerThreadFactory-10187-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr ] o.a.s.c.a.c.CreateCollectionCmd Create collection forwardingCollection
[junit4] 2> 2562810 INFO (OverseerStateUpdate-99385412319903749-127.0.0.1:37157_solr-n_0000000000) [n:127.0.0.1:37157_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"forwardingCollection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"forwardingCollection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:38447/solr",
[junit4] 2> "type":"NRT",
[junit4] 2> "waitForFinalState":"false"}
[junit4] 2> 2563013 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 2563013 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2563117 INFO (zkCallback-4406-thread-1-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2563117 INFO (zkCallback-4406-thread-2-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2564027 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.3.0
[junit4] 2> 2564042 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema [forwardingCollection_shard1_replica_n1] Schema name=test
[junit4] 2> 2564126 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.0 with uniqueid field id
[junit4] 2> 2564132 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'forwardingCollection_shard1_replica_n1' using configuration from collection forwardingCollection, trusted=true
[junit4] 2> 2564132 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_38447.solr.core.forwardingCollection.shard1.replica_n1' (registry 'solr.core.forwardingCollection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@9e9dff
[junit4] 2> 2564132 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 2564132 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [[forwardingCollection_shard1_replica_n1] ] Opening new SolrCore at [/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_A00A40A63F260ADE-001/tempDir-001/node2/forwardingCollection_shard1_replica_n1], dataDir=[/home/jenkins/workspace/Lucene-Solr-7.x-Linux/solr/build/solr-core/test/J1/temp/solr.cloud.TestSolrCloudWithSecureImpersonation_A00A40A63F260ADE-001/tempDir-001/node2/./forwardingCollection_shard1_replica_n1/data/]
[junit4] 2> 2564135 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.AlcoholicMergePolicy: [AlcoholicMergePolicy: minMergeSize=0, mergeFactor=10, maxMergeSize=807357472, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.1]
[junit4] 2> 2564171 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 2564171 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 2564172 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 2564172 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 2564173 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogDocMergePolicy: [LogDocMergePolicy: minMergeSize=1000, mergeFactor=18, maxMergeSize=9223372036854775807, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3185573636302058]
[junit4] 2> 2564173 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@1eabbca[forwardingCollection_shard1_replica_n1] main]
[junit4] 2> 2564174 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Initializing spell checkers
[junit4] 2> 2564199 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.DirectSolrSpellChecker init: {name=direct,classname=DirectSolrSpellChecker,field=lowerfilt,minQueryLength=3}
[junit4] 2> 2564281 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000ms.
[junit4] 2> 2564281 INFO (searcherExecutor-10192-thread-1-processing-n:127.0.0.1:38447_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: default
[junit4] 2> 2564281 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1590166600335491072
[junit4] 2> 2564281 INFO (searcherExecutor-10192-thread-1-processing-n:127.0.0.1:38447_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: direct
[junit4] 2> 2564281 INFO (searcherExecutor-10192-thread-1-processing-n:127.0.0.1:38447_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: wordbreak
[junit4] 2> 2564281 INFO (searcherExecutor-10192-thread-1-processing-n:127.0.0.1:38447_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: multipleFields
[junit4] 2> 2564281 INFO (searcherExecutor-10192-thread-1-processing-n:127.0.0.1:38447_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: jarowinkler
[junit4] 2> 2564281 INFO (searcherExecutor-10192-thread-1-processing-n:127.0.0.1:38447_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: external
[junit4] 2> 2564281 INFO (searcherExecutor-10192-thread-1-processing-n:127.0.0.1:38447_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: freq
[junit4] 2> 2564281 INFO (searcherExecutor-10192-thread-1-processing-n:127.0.0.1:38447_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: fqcn
[junit4] 2> 2564282 INFO (searcherExecutor-10192-thread-1-processing-n:127.0.0.1:38447_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.h.c.SpellCheckComponent Loading spell index for spellchecker: perDict
[junit4] 2> 2564282 INFO (searcherExecutor-10192-thread-1-processing-n:127.0.0.1:38447_solr x:forwardingCollection_shard1_replica_n1 s:shard1 c:forwardingCollection r:core_node2) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] Registered new searcher Searcher@1eabbca[forwardingCollection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 2564284 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 2564284 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 2564284 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:38447/solr/forwardingCollection_shard1_replica_n1/
[junit4] 2> 2564284 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 2564284 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:38447/solr/forwardingCollection_shard1_replica_n1/ has no replicas
[junit4] 2> 2564284 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 2564285 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:38447/solr/forwardingCollection_shard1_replica_n1/ shard1
[junit4] 2> 2564386 INFO (zkCallback-4406-thread-1-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2564386 INFO (zkCallback-4406-thread-2-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2564436 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 2564437 INFO (qtp13530183-22707) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf1&newCollection=true&name=forwardingCollection_shard1_replica_n1&action=CREATE&numShards=1&collection=forwardingCollection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1424
[junit4] 2> 2564437 WARN (httpShardExecutor-10181-thread-1-processing-n:127.0.0.1:37157_solr [http:////127.0.0.1:38447//solr] http:////127.0.0.1:38447//solr) [n:127.0.0.1:37157_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1516537044278&s=Q73cJhG1ewfXTdTL6lh3pQSKAIA="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:24 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:24 GMT
[junit4] 2> 2564439 INFO (qtp4786941-22718) [n:127.0.0.1:37157_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 2564537 INFO (zkCallback-4406-thread-2-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2564537 INFO (zkCallback-4406-thread-1-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [2])
[junit4] 2> 2564707 INFO (OverseerCollectionConfigSetProcessor-99385412319903749-127.0.0.1:37157_solr-n_0000000000) [n:127.0.0.1:37157_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 2565440 INFO (qtp4786941-22718) [n:127.0.0.1:37157_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=1&collection.configName=conf1&maxShardsPerNode=1&name=forwardingCollection&nrtReplicas=1&action=CREATE&numShards=1&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=2734
[junit4] 2> 2565440 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1516537043971&s=8DO5YRHmCYQHokjEK+11fuIxXnE="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:23 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:23 GMT
[junit4] 2> 2565440 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[A00A40A63F260ADE]) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: forwardingCollection failOnTimeout:true timeout (sec):100
[junit4] 2> 2565440 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[A00A40A63F260ADE]) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: forwardingCollection
[junit4] 2> 2565442 INFO (qtp4786941-22718) [n:127.0.0.1:37157_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 2565444 INFO (qtp13530183-22719) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2565444 WARN (qtp4786941-22718) [n:127.0.0.1:37157_solr ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1516537046709&s=0SCOO8HyfBqSrpPoF1h039NEVXo="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:26 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:26 GMT
[junit4] 2> 2565445 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1516537046708&s=JlJlZVTfmilH2OUvfUwJTuyKjBo="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:26 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:26 GMT
[junit4] 2> 2565445 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=$&p=$&t=test&e=1516537046709&s=0SCOO8HyfBqSrpPoF1h039NEVXo="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:26 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:26 GMT
[junit4] 2> 2565448 INFO (qtp13530183-22719) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.S.Request [forwardingCollection_shard1_replica_n1] webapp=/solr path=/select params={q=*:*&wt=javabin&version=2} hits=0 status=0 QTime=0
[junit4] 2> 2565448 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=user&p=user&t=test&e=1516537046713&s=KNa2Vp22HJwoNLbutB1tM+QDIYM="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:26 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:26 GMT
[junit4] 2> 2565448 INFO (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testForwarding
[junit4] 2> 2565468 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigHosts
[junit4] 2> 2565470 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noHosts&p=noHosts&t=test&e=1516537046734&s=9XToX7oy3zslxl4ILyXo2Ebk1Fw="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:26 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:26 GMT
[junit4] 2> 2565470 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigHosts-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigHosts
[junit4] 2> 2565488 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyUnknownRemote
[junit4] 2> 2577907 WARN (jetty-launcher-4388-thread-2-SendThread(127.0.0.1:42759)) [n:127.0.0.1:38447_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 13369ms for sessionid 0x1611681852f0006
[junit4] 2> 2577908 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x1611681852f0006, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2577908 WARN (jetty-launcher-4388-thread-2-SendThread(127.0.0.1:42759)) [n:127.0.0.1:38447_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15482ms for sessionid 0x1611681852f0007
[junit4] 2> 2577908 WARN (jetty-launcher-4388-thread-1-SendThread(127.0.0.1:42759)) [n:127.0.0.1:37157_solr ] o.a.z.ClientCnxn Client session timed out, have not heard from server in 15482ms for sessionid 0x1611681852f0008
[junit4] 2> 2577910 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=localHostAnyGroup&p=localHostAnyGroup&t=test&e=1516537046754&s=D42gEqtv+fLeXQ5TtpUFrVsOcYE="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:26 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:26 GMT
[junit4] 2> 2577911 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyUnknownRemote-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyUnknownRemote
[junit4] 2> 2577915 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x1611681852f0008, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2577915 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x1611681852f0007, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 2577949 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyNoConfigGroups
[junit4] 2> 2577951 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=noGroups&p=noGroups&t=test&e=1516537059215&s=PXI3M5EP7FFzUfvjTOxRZP5aQiQ="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:39 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:39 GMT
[junit4] 2> 2577952 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyNoConfigGroups-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyNoConfigGroups
[junit4] 2> 2577984 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyWrongHost
[junit4] 2> 2578009 WARN (zkConnectionManagerCallback-4407-thread-1-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@312d7b name: ZooKeeperConnection Watcher:127.0.0.1:42759/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 2578010 WARN (zkConnectionManagerCallback-4407-thread-1-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 2578010 WARN (zkConnectionManagerCallback-4419-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@15ef8ff name: ZooKeeperConnection Watcher:127.0.0.1:42759/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None
[junit4] 2> 2578010 WARN (zkConnectionManagerCallback-4419-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient has disconnected
[junit4] 2> 2583018 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=wrongHost&p=wrongHost&t=test&e=1516537059251&s=G6UAWrj7Lhfx5V4nfOCa1/Vm/pk="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:39 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:39 GMT
[junit4] 2> 2583018 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyWrongHost-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyWrongHost
[junit4] 2> 2583020 WARN (jetty-launcher-4388-thread-1-SendThread(127.0.0.1:42759)) [n:127.0.0.1:37157_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x1611681852f0008 has expired
[junit4] 2> 2583024 WARN (zkConnectionManagerCallback-4419-thread-1) [ ] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@15ef8ff name: ZooKeeperConnection Watcher:127.0.0.1:42759/solr got event WatchedEvent state:Expired type:None path:null path: null type: None
[junit4] 2> 2583021 WARN (TEST-TestSolrCloudWithSecureImpersonation.testForwarding-seed#[A00A40A63F260ADE]-SendThread(127.0.0.1:42759)) [ ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x1611681852f000b has expired
[junit4] 2> 2583020 WARN (jetty-launcher-4388-thread-2-SendThread(127.0.0.1:42759)) [n:127.0.0.1:38447_solr ] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x1611681852f0007 has expired
[junit4] 2> 2583028 INFO (zkConnectionManagerCallback-4407-thread-1-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2583024 WARN (zkConnectionManagerCallback-4419-thread-1) [ ] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper...
[junit4] 2> 2583029 WARN (zkConnectionManagerCallback-4419-thread-1) [ ] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one...
[junit4] 2> 2583039 INFO (zkConnectionManagerCallback-4419-thread-1-EventThread) [ ] o.a.s.c.c.ConnectionManager zkClient has connected
[junit4] 2> 2583040 INFO (zkConnectionManagerCallback-4419-thread-1) [ ] o.a.s.c.c.ConnectionManager Connection with ZooKeeper reestablished.
[junit4] 2> 2583048 INFO (zkConnectionManagerCallback-4419-thread-1) [ ] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper
[junit4] 2> 2583048 INFO (zkConnectionManagerCallback-4419-thread-1) [ ] o.a.s.c.c.ConnectionManager zkClient Connected:true
[junit4] 2> 2583065 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyValidateAnyHostAnyUser
[junit4] 2> 2583066 INFO (qtp4786941-22720) [n:127.0.0.1:37157_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :list with params doAs=bar&action=LIST&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 2583066 INFO (qtp4786941-22720) [n:127.0.0.1:37157_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={doAs=bar&action=LIST&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 2583066 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=anyHostAnyUser&p=anyHostAnyUser&t=test&e=1516537064332&s=UKcjBby+YN/Vdwg09SuwoETgZ70="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:44 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:44 GMT
[junit4] 2> 2583066 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyValidateAnyHostAnyUser-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyValidateAnyHostAnyUser
[junit4] 2> 2583085 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testProxyInvalidGroup
[junit4] 2> 2583121 WARN (qtp4786941-22718) [n:127.0.0.1:37157_solr ] o.a.h.s.ShellBasedUnixGroupsMapping got exception trying to get groups for user bar: id: ???bar???: no such user
[junit4] 2> id: ???bar???: no such user
[junit4] 2>
[junit4] 2> 2583123 WARN (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[A00A40A63F260ADE]) [ ] o.a.h.c.p.ResponseProcessCookies Invalid cookie header: "Set-Cookie: hadoop.auth="u=bogusGroup&p=bogusGroup&t=test&e=1516537064351&s=jWXaHoTuqAW/oe4eU6GWDe1TP+E="; Path=/; Domain=127.0.0.1; Expires=Domh, 21-Ean-2018 12:17:44 GMT; HttpOnly". Invalid 'expires' attribute: Domh, 21-Ean-2018 12:17:44 GMT
[junit4] 2> 2583124 INFO (TEST-TestSolrCloudWithSecureImpersonation.testProxyInvalidGroup-seed#[A00A40A63F260ADE]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testProxyInvalidGroup
[junit4] 2> 2583160 INFO (jetty-closer-4389-thread-1) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@168ff13{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 2583160 INFO (jetty-closer-4389-thread-2) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@c1a806{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 2583161 INFO (jetty-closer-4389-thread-1) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=33127686
[junit4] 2> 2583161 INFO (jetty-closer-4389-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2583161 INFO (jetty-closer-4389-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@15ca224: rootName = solr_37157, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1d1f5ca
[junit4] 2> 2583163 INFO (jetty-closer-4389-thread-2) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=4625106
[junit4] 2> 2583163 INFO (jetty-closer-4389-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 2583163 INFO (jetty-closer-4389-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@1f678cf: rootName = solr_38447, domain = solr.node, service url = null, agent id = null] for registry solr.node / com.codahale.metrics.MetricRegistry@1437131
[junit4] 2> 2583167 INFO (jetty-closer-4389-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2583167 INFO (jetty-closer-4389-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@6fafc5: rootName = solr_37157, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@e5a268
[junit4] 2> 2583169 INFO (jetty-closer-4389-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 2583169 INFO (jetty-closer-4389-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@121c1e3: rootName = solr_38447, domain = solr.jvm, service url = null, agent id = null] for registry solr.jvm / com.codahale.metrics.MetricRegistry@e5a268
[junit4] 2> 2583172 INFO (jetty-closer-4389-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2583172 INFO (jetty-closer-4389-thread-1) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@b886e9: rootName = solr_37157, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1afcaee
[junit4] 2> 2583175 INFO (jetty-closer-4389-thread-1) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:37157_solr
[junit4] 2> 2583175 INFO (jetty-closer-4389-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 2583176 INFO (jetty-closer-4389-thread-2) [ ] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@317ae2: rootName = solr_38447, domain = solr.jetty, service url = null, agent id = null] for registry solr.jetty / com.codahale.metrics.MetricRegistry@1afcaee
[junit4] 2> 2583176 INFO (zkCallback-4406-thread-6-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2583176 INFO (zkCallback-4404-thread-1-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 2583177 INFO (jetty-closer-4389-thread-1) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2583178 INFO (jetty-closer-4389-thread-2) [ ] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/127.0.0.1:38447_solr
[junit4] 2> 2583178 INFO (zkCallback-4406-thread-6-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2583178 INFO (zkCallback-4406-thread-3-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/forwardingCollection/state.json] for collection [forwardingCollection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 2583179 INFO (jetty-closer-4389-thread-1) [ ] o.a.s.c.Overseer Overseer (id=99385412319903749-127.0.0.1:37157_solr-n_0000000000) closing
[junit4] 2> 2583179 INFO (zkCallback-4406-thread-6-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 2583179 INFO (OverseerStateUpdate-99385412319903749-127.0.0.1:37157_solr-n_0000000000) [n:127.0.0.1:37157_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:37157_solr
[junit4] 2> 2583179 WARN (OverseerAutoScalingTriggerThread-99385412319903749-127.0.0.1:37157_solr-n_0000000000) [n:127.0.0.1:37157_solr ] o.a.s.c.a.OverseerTriggerThread OverseerTriggerThread woken up but we are closed, exiting.
[junit4] 2> 2583180 INFO (jetty-closer-4389-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 2583189 INFO (zkCallback-4406-thread-6-processing-n:127.0.0.1:38447_solr) [n:127.0.0.1:38447_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:38447_solr
[junit4] 2> 2583190 WARN (zkCallback-4404-thread-2-processing-n:127.0.0.1:37157_solr) [n:127.0.0.1:37157_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 2583203 INFO (coreCloseExecutor-10198-thread-1) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.c.SolrCore [forwardingCollection_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@8e2461
[junit4] 2> 2583203 INFO (coreCloseExecutor-10198-thread-1) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.forwardingCollection.shard1.replica_n1, tag=9315425
[junit4] 2> 2583203 ERROR (Thread[Thread-5884,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:37157_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 2583203 INFO (coreCloseExecutor-10198-thread-1) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter Closing reporter [org.apache.solr.metrics.reporters.SolrJmxReporter@7938e9: rootName = solr_38447, domain = solr.core.forwardingCollection.shard1.replica_n1, service url = null, agent id = null] for registry solr.core.forwardingCollection.shard1.replica_n1 / com.codahale.metrics.MetricRegistry@1f28450
[junit4] 2> 2583204 INFO (jetty-closer-4389-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@1976d70{/solr,null,UNAVAILABLE}
[junit4] 2> 2583204 INFO (jetty-closer-4389-thread-1) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2583215 INFO (coreCloseExecutor-10198-thread-1) [n:127.0.0.1:38447_solr c:forwardingCollection s:shard1 r:core_node2 x:forwardingCollection_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.forwardingCollection.shard1.leader, tag=9315425
[junit4] 2> 2583216 ERROR (Thread[Thread-5887,5,TGRP-TestSolrCloudWithSecureImpersonation]) [n:127.0.0.1:38447_solr ] o.a.h.s.t.d.AbstractDelegationTokenSecretManager ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted
[junit4] 2> 2583216 INFO (jetty-closer-4389-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@13aa35a{/solr,null,UNAVAILABLE}
[junit4] 2> 2583216 INFO (jetty-closer-4389-thread-2) [ ] o.e.j.s.session Stopped scavenging
[junit4] 2> 2583216 ERROR (SUITE-TestSolrCloudWithSecureImpersonation-seed#[A00A40A63F260ADE]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2583217 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[A00A40A63F260ADE]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42759 42759
[junit4] 2> 2591837 INFO (Thread-5867) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:42759 42759
[junit4] 2> 2591837 WARN (Thread-5867) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/aliases.json
[junit4] 2> 4 /solr/clusterprops.json
[junit4] 2> 2 /solr/security.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 6 /solr/collections/forwardingCollection/state.json
[junit4] 2> 4 /solr/clusterstate.json
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMKeyIdRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_1
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_3
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_2
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot/DK_4
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMSeqNumRoot
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 4 /solr/live_nodes
[junit4] 2> 4 /solr/collections
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMMasterKeyRoot
[junit4] 2> 2 /solr/security/zkdtsm/ZKDTSMRoot/ZKDTSMTokensRoot
[junit4] 2>
[junit4] 2> 2591854 INFO (SUITE-TestSolrCloudWithSecureImpersonation-seed#[A00A40A63F260ADE]-worker) [ ] o.a.s.SolrTestCaseJ4 ------------------------------------------------------- Done waiting for tracked resources to be released
[junit4] 2> Jan 21, 2018 2:17:53 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 2 leaked thread(s).
[junit4] 2> Jan 21, 2018 2:18:13 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestSolrCloudWithSecureImpersonation:
[junit4] 2> 1) Thread[id=22760, name=jetty-launcher-4388-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> 2) Thread[id=22756, name=jetty-launcher-4388-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> at sun.misc.Unsafe.park(Native Method)
[junit4] 2> at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1037)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> Jan 21, 2018 2:18:13 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll
[junit4] 2> INFO: Starting to interrupt leaked threads:
[junit4] 2> 1) Thread[id=22760, name=jetty-launcher-4388-thread-1-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> 2) Thread[id=22756, name=jetty-launcher-4388-thread-2-EventThread, state=TIMED_WAITING, group=TGRP-TestSolrCloudWithSecureImpersonation]
[junit4] 2> 2611996 ERROR (jetty-launcher-4388-thread-1-EventThread) [n:127.0.0.1:37157_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.framework.imps.NamespaceWatcher.process(NamespaceWatcher.java:67)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:530)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:505)
[junit4] 2> 2611996 ERROR (jetty-launcher-4388-thread-2-EventThread) [n:127.0.0.1:38447_solr ] o.a.c.f.i.CuratorFrameworkImpl Watcher exception
[junit4] 2> java.lang.InterruptedException
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.doAcquireSharedNanos(AbstractQueuedSynchronizer.java:1039)
[junit4] 2> at java.util.concurrent.locks.AbstractQueuedSynchronizer.tryAcquireSharedNanos(AbstractQueuedSynchronizer.java:1328)
[junit4] 2> at java.util.concurrent.CountDownLatch.await(CountDownLatch.java:277)
[junit4] 2> at org.apache.curator.CuratorZookeeperClient.internalBlockUntilConnectedOrTimedOut(CuratorZookeeperClient.java:323)
[junit4] 2> at org.apache.curator.RetryLoop.callWithRetry(RetryLoop.java:105)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.pathInForeground(GetDataBuilderImpl.java:288)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:279)
[junit4] 2> at org.apache.curator.framework.imps.GetDataBuilderImpl.forPath(GetDataBuilderImpl.java:41)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.readValue(SharedValue.java:244)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue.access$100(SharedValue.java:44)
[junit4] 2> at org.apache.curator.framework.recipes.shared.SharedValue$1.process(SharedValue.java:61)
[junit4] 2> at org.apache.curator.fr
[...truncated too long message...]
ad(127.0.0.1:42759)) [n:127.0.0.1:38447_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2> 3244604 WARN (jetty-launcher-4388-thread-1-SendThread(127.0.0.1:42759)) [n:127.0.0.1:37157_solr ] o.a.z.ClientCnxn Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
[junit4] 2> java.net.ConnectException: Connection refused
[junit4] 2> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
[junit4] 2> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:717)
[junit4] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:361)
[junit4] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1141)
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {field6=PostingsFormat(name=Memory), field8=PostingsFormat(name=Asserting), field2=PostingsFormat(name=Memory), field4=PostingsFormat(name=Asserting)}, docValues:{}, maxPointsInLeafNode=1960, maxMBSortInHeap=7.165339412925299, sim=RandomSimilarity(queryNorm=false): {}, locale=sr-CS, timezone=Australia/Broken_Hill
[junit4] 2> NOTE: Linux 4.13.0-26-generic i386/Oracle Corporation 1.8.0_144 (32-bit)/cpus=8,threads=1,free=268363320,total=518979584
[junit4] 2> NOTE: All tests run in this JVM: [ZkControllerTest, TestSimpleTrackingShardHandler, CachingDirectoryFactoryTest, TestDocBasedVersionConstraints, FieldMutatingUpdateProcessorTest, PrimitiveFieldTypeTest, CSVRequestHandlerTest, SimplePostToolTest, AsyncCallRequestStatusResponseTest, BadComponentTest, PolyFieldTest, TimeRoutedAliasUpdateProcessorTest, DirectUpdateHandlerOptimizeTest, TestSolr4Spatial, SolrCoreTest, TestReqParamsAPI, SampleTest, TestSolrCloudWithDelegationTokens, BlockJoinFacetDistribTest, TestDFISimilarityFactory, DOMUtilTest, TestReplicationHandler, TestJettySolrRunner, TestManagedSchemaAPI, PeerSyncTest, LegacyCloudClusterPropTest, QueryEqualityTest, HdfsTlogReplayBufferedWhileIndexingTest, TestRandomFlRTGCloud, SOLR749Test, JsonLoaderTest, SliceStateTest, TestGenericDistributedQueue, BasicFunctionalityTest, TestRTGBase, VMParamsZkACLAndCredentialsProvidersTest, TestLocalFSCloudBackupRestore, TestSystemCollAutoCreate, MoveReplicaHDFSFailoverTest, RulesTest, TestZkChroot, TestCloudPseudoReturnFields, SchemaApiFailureTest, HdfsNNFailoverTest, TestExactSharedStatsCache, TestPostingsSolrHighlighter, TestFieldCacheReopen, FastVectorHighlighterTest, CollectionStateFormat2Test, UpdateRequestProcessorFactoryTest, TestSearcherReuse, PropertiesRequestHandlerTest, AlternateDirectoryTest, TestSolrIndexConfig, DeleteShardTest, LeaderFailureAfterFreshStartTest, IndexSchemaTest, TestDistributedStatsComponentCardinality, SchemaVersionSpecificBehaviorTest, QueryParsingTest, DataDrivenBlockJoinTest, TestTlogReplica, SolrJmxReporterTest, TestLockTree, QueryElevationComponentTest, TestStressVersions, BlockDirectoryTest, BasicZkTest, TestFoldingMultitermQuery, TestSolrCloudSnapshots, SpatialHeatmapFacetsTest, SharedFSAutoReplicaFailoverTest, TestRequestForwarding, TestLRUCache, JvmMetricsTest, TestStandardQParsers, TestFreeTextSuggestions, ConnectionManagerTest, ResponseHeaderTest, TestNumericRangeQuery64, GraphQueryTest, DistributedFacetPivotLargeTest, UninvertDocValuesMergePolicyTest, LoggingHandlerTest, TestConfigsApi, TestSimpleTextCodec, TestSchemaNameResource, DistributedIntervalFacetingTest, AddReplicaTest, StatsReloadRaceTest, TestTriggerIntegration, TestLeaderElectionWithEmptyReplica, ComputePlanActionTest, TestExportWriter, TestSolr4Spatial2, TestShortCircuitedRequests, TestOverriddenPrefixQueryForCustomFieldType, SystemInfoHandlerTest, TestFieldResource, TestSubQueryTransformerDistrib, SortByFunctionTest, TestChildDocTransformer, SolrMetricManagerTest, DistributedDebugComponentTest, TestSweetSpotSimilarityFactory, TestConfigSetsAPIZkFailure, RequiredFieldsTest, TestMissingGroups, TestEmbeddedSolrServerAdminHandler, HdfsCollectionsAPIDistributedZkTest, TestCoreBackup, TestFunctionQuery, AddBlockUpdateTest, TestLegacyTerms, TestRecovery, HttpTriggerListenerTest, TestScoreJoinQPNoScore, TestFuzzyAnalyzedSuggestions, TestRestManager, TestBulkSchemaConcurrent, TestSurroundQueryParser, QueryResultKeyTest, ChaosMonkeySafeLeaderTest, XsltUpdateRequestHandlerTest, RollingRestartTest, BasicDistributedZk2Test, SyncSliceTest, OpenCloseCoreStressTest, OverseerTest, RecoveryZkTest, TestRandomFaceting, ZkSolrClientTest, ShardRoutingCustomTest, TestDistributedSearch, TestDistributedGrouping, DistributedSpellCheckComponentTest, TestJoin, TestReload, TestCoreContainer, StatsComponentTest, SpellCheckComponentTest, SolrCmdDistributorTest, BadIndexSchemaTest, TestSort, TestFiltering, DirectUpdateHandlerTest, TestBadConfig, HighlighterTest, SoftAutoCommitTest, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, SignatureUpdateProcessorFactoryTest, TestExtendedDismaxParser, SuggesterFSTTest, SolrRequestParserTest, DocValuesTest, SuggesterTest, TestTrie, NoCacheHeaderTest, SolrCoreCheckLockOnStartupTest, TestUpdate, TestAtomicUpdateErrorCases, StatelessScriptUpdateProcessorFactoryTest, DocValuesMultiTest, DistanceFunctionTest, TestSolrDeletionPolicy1, SolrInfoBeanTest, DebugComponentTest, TestQueryUtils, DirectSolrSpellCheckerTest, TestReversedWildcardFilterFactory, TestQueryTypes, TestOmitPositions, TermsComponentTest, RequestHandlersTest, DocumentBuilderTest, TestValueSourceCache, PathHierarchyTokenizerFactoryTest, TestIndexingPerformance, MoreLikeThisHandlerTest, FieldAnalysisRequestHandlerTest, IndexSchemaRuntimeFieldTest, RegexBoostProcessorTest, SolrPluginUtilsTest, TestJmxIntegration, TestCollationField, TestCSVResponseWriter, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, TestPHPSerializedResponseWriter, SearchHandlerTest, HighlighterConfigTest, UpdateParamsTest, SolrIndexConfigTest, TestStressRecovery, TestDocSet, TestBinaryField, TestSearchPerf, NumericFieldsTest, TestElisionMultitermQuery, TestConfig, ExternalFileFieldSortTest, TestSolrCoreProperties, DirectSolrConnectionTest, TestLuceneMatchVersion, TestPhraseSuggestions, SpellPossibilityIteratorTest, TestCharFilters, TestCodecSupport, SynonymTokenizerTest, TestXIncludeConfig, TestDFRSimilarityFactory, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, TestLMJelinekMercerSimilarityFactory, TestBM25SimilarityFactory, TestFastWriter, ResourceLoaderTest, ScriptEngineTest, URLClassifyProcessorTest, TestFastLRUCache, DateMathParserTest, ChaosMonkeyNothingIsSafeTest, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, SpellingQueryConverterTest, ClusterStateTest, TestSolrJ, TestDocumentBuilder, FileUtilsTest, DistributedMLTComponentTest, SolrTestCaseJ4Test, TestCrossCoreJoin, TestCursorMarkWithoutUniqueKey, TestHighlightDedupGrouping, TestTolerantSearch, TestEmbeddedSolrServerConstructors, ConnectionReuseTest, ConfigSetsAPITest, DeleteLastCustomShardedReplicaTest, DeleteReplicaTest, DistribCursorPagingTest, DistribDocExpirationUpdateProcessorTest, HttpPartitionTest, MoveReplicaTest, MultiThreadedOCPTest, OverseerCollectionConfigSetProcessorTest, OverseerModifyCollectionTest, OverseerRolesTest, OverseerTaskQueueTest, RecoveryAfterSoftCommitTest, SolrXmlInZkTest, TestCloudDeleteByQuery, TestCloudInspectUtil, TestCloudJSONFacetJoinDomain, TestClusterProperties, TestConfigSetsAPIExclusivity, TestExclusionRuleCollectionAccess, TestMiniSolrCloudClusterSSL, TestPullReplica, TestSolrCloudWithSecureImpersonation, TestTolerantUpdateProcessorRandomCloud, TlogReplayBufferedWhileIndexingTest, ZkFailoverTest, AutoAddReplicasPlanActionTest, MetricTriggerTest, NodeAddedTriggerTest, NodeLostTriggerTest, SystemLogListenerTest, TestPolicyCloud, TestExecutePlanAction, TestLargeCluster, CdcrBootstrapTest, BlobRepositoryCloudTest, TestCustomStream, TestReplicationHandlerBackup, AutoscalingHistoryHandlerTest, SolrCloudReportersTest, TestCollationFieldDocValues, TestHalfAndHalfDocValues, TestManagedSchemaThreadSafety, TestSchemaManager, TestUseDocValuesAsStored2, AnalyticsQueryTest, CurrencyRangeFacetCloudTest, CursorMarkTest, LargeFieldTest, MergeStrategyTest, TestAddFieldRealTimeGet, TestCollapseQParserPlugin, TestCustomSort, TestLegacyNumericRangeQueryBuilder, TestMaxScoreQueryParser, TestQueryWrapperFilter, TestReRankQParserPlugin, TestReloadDeadlock, TestSimpleQParserPlugin, TestSmileRequest, TestSolrCoreParser, TestXmlQParser, TestXmlQParserPlugin, TestJsonFacetRefinement, TestJsonFacets, TestLRUStatsCache, BasicAuthIntegrationTest, TestAuthorizationFramework, TestFieldCacheWithThreads, TestNumericTerms32, TestNumericTerms64]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=TestNumericTerms64 -Dtests.seed=A00A40A63F260ADE -Dtests.multiplier=3 -Dtests.slow=true -Dtests.locale=sr-CS -Dtests.timezone=Australia/Broken_Hill -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] ERROR 0.00s J1 | TestNumericTerms64 (suite) <<<
[junit4] > Throwable #1: java.lang.AssertionError: The test or suite printed 13416 bytes to stdout and stderr, even though the limit was set to 8192 bytes. Increase the limit with @Limit, ignore it completely with @SuppressSysoutChecks or run with -Dtests.verbose=true
[junit4] > at __randomizedtesting.SeedInfo.seed([A00A40A63F260ADE]:0)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] Completed [740/767 (2!)] on J1 in 6.30s, 4 tests, 1 failure <<< FAILURES!
[...truncated 44002 lines...]