You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Policeman Jenkins Server <je...@thetaphi.de> on 2017/07/07 06:52:56 UTC
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 12 -
Failure!
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/12/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
No tests ran.
Build Log:
[...truncated 11038 lines...]
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/init-core-data-001
[junit4] 2> 323991 WARN (SUITE-FullSolrCloudDistribCmdsTest-seed#[B25CCE85E23EA6A1]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=2 numCloses=2
[junit4] 2> 323992 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[B25CCE85E23EA6A1]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 323994 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[B25CCE85E23EA6A1]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 323994 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[B25CCE85E23EA6A1]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /pq/
[junit4] 2> 323995 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 323995 INFO (Thread-498) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 323995 INFO (Thread-498) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 323998 ERROR (Thread-498) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 324096 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.ZkTestServer start zk server on port:62031
[junit4] 2> 324131 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 324134 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 324136 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 324138 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 324139 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 324141 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 324143 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 324144 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 324146 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 324148 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 324150 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 324152 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 324415 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 324417 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@456563f9{/pq,null,AVAILABLE}
[junit4] 2> 324418 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@617aa48a{HTTP/1.1,[http/1.1]}{127.0.0.1:62035}
[junit4] 2> 324418 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server Started @328019ms
[junit4] 2> 324418 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/tempDir-001/control/data, hostContext=/pq, hostPort=62035, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/control-001/cores}
[junit4] 2> 324418 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 324418 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 324418 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 324418 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 324418 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T06:02:59.633Z
[junit4] 2> 324421 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 324421 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/control-001/solr.xml
[junit4] 2> 324433 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 324436 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62031/solr
[junit4] 2> 324574 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62035_pq ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 324575 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62035_pq ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:62035_pq
[junit4] 2> 324577 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62035_pq ] o.a.s.c.Overseer Overseer (id=98265162004037636-127.0.0.1:62035_pq-n_0000000000) starting
[junit4] 2> 324587 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62035_pq ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62035_pq
[junit4] 2> 324589 INFO (OverseerStateUpdate-98265162004037636-127.0.0.1:62035_pq-n_0000000000) [n:127.0.0.1:62035_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 324682 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62035_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 324686 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62035_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 324686 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62035_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 324687 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62035_pq ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/control-001/cores
[junit4] 2> 324707 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 324709 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:62031/solr ready
[junit4] 2> 324711 INFO (qtp1558114381-2415) [n:127.0.0.1:62035_pq ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:62035_pq&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 324714 INFO (OverseerThreadFactory-977-thread-1-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 324827 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 324828 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 324939 INFO (zkCallback-374-thread-1-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 325863 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 325874 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 325916 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 325937 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 325938 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 325938 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 325938 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 325940 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3466218972926834]
[junit4] 2> 325942 WARN (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 325984 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 325984 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 325985 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 325985 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 325986 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 325986 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3e690845[control_collection_shard1_replica_n1] main]
[junit4] 2> 325987 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 325988 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 325988 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 325989 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572242594153365504
[junit4] 2> 325990 INFO (searcherExecutor-980-thread-1-processing-n:127.0.0.1:62035_pq x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@3e690845[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 325996 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 325996 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 325996 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:62035/pq/control_collection_shard1_replica_n1/
[junit4] 2> 325996 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 325996 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:62035/pq/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 325996 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 326000 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:62035/pq/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 326115 INFO (zkCallback-374-thread-1-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 326167 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 326173 INFO (qtp1558114381-2417) [n:127.0.0.1:62035_pq c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1346
[junit4] 2> 326183 INFO (qtp1558114381-2415) [n:127.0.0.1:62035_pq ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 326284 INFO (zkCallback-374-thread-1-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 326718 INFO (OverseerCollectionConfigSetProcessor-98265162004037636-127.0.0.1:62035_pq-n_0000000000) [n:127.0.0.1:62035_pq ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 327190 INFO (qtp1558114381-2415) [n:127.0.0.1:62035_pq ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:62035_pq&wt=javabin&version=2} status=0 QTime=2478
[junit4] 2> 327193 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15d1ba4eb0c0005, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 327199 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 327201 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:62031/solr ready
[junit4] 2> 327201 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 327203 INFO (qtp1558114381-2420) [n:127.0.0.1:62035_pq ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 327206 INFO (OverseerThreadFactory-977-thread-2-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 327207 WARN (OverseerThreadFactory-977-thread-2-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 327437 INFO (qtp1558114381-2420) [n:127.0.0.1:62035_pq ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 327437 INFO (qtp1558114381-2420) [n:127.0.0.1:62035_pq ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=234
[junit4] 2> 327828 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-1-001 of type NRT
[junit4] 2> 327829 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 327830 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3fc59b61{/pq,null,AVAILABLE}
[junit4] 2> 327831 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@97a5cf8{HTTP/1.1,[http/1.1]}{127.0.0.1:62049}
[junit4] 2> 327831 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server Started @331432ms
[junit4] 2> 327831 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/pq, hostPort=62049, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-1-001/cores}
[junit4] 2> 327831 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 327832 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 327832 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 327832 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 327832 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T06:03:03.047Z
[junit4] 2> 327836 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 327836 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-1-001/solr.xml
[junit4] 2> 327844 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 327849 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62031/solr
[junit4] 2> 327869 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62049_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 327876 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62049_pq ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 327879 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62049_pq ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62049_pq
[junit4] 2> 327882 INFO (zkCallback-381-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 327883 INFO (zkCallback-386-thread-1-processing-n:127.0.0.1:62049_pq) [n:127.0.0.1:62049_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 327882 INFO (zkCallback-374-thread-1-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 328057 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62049_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 328063 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62049_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 328063 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62049_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 328065 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62049_pq ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-1-001/cores
[junit4] 2> 328099 INFO (qtp1053861804-2456) [n:127.0.0.1:62049_pq ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:62049_pq&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 328104 INFO (OverseerThreadFactory-977-thread-3-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:62049_pq for creating new replica
[junit4] 2> 328104 INFO (OverseerCollectionConfigSetProcessor-98265162004037636-127.0.0.1:62035_pq-n_0000000000) [n:127.0.0.1:62035_pq ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 328107 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n0&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 328107 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 329143 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 329155 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.s.IndexSchema [collection1_shard2_replica_n0] Schema name=test
[junit4] 2> 329238 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 329270 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n0' using configuration from collection collection1, trusted=true
[junit4] 2> 329270 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n0' (registry 'solr.core.collection1.shard2.replica_n0') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 329271 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 329271 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SolrCore [[collection1_shard2_replica_n0] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-1-001/cores/collection1_shard2_replica_n0], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-1-001/cores/collection1_shard2_replica_n0/data/]
[junit4] 2> 329275 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3466218972926834]
[junit4] 2> 329278 WARN (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 329347 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 329347 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 329349 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 329349 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 329350 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 329351 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.s.SolrIndexSearcher Opening [Searcher@59c0d9db[collection1_shard2_replica_n0] main]
[junit4] 2> 329353 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 329353 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 329354 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 329354 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572242597681823744
[junit4] 2> 329358 INFO (searcherExecutor-991-thread-1-processing-n:127.0.0.1:62049_pq x:collection1_shard2_replica_n0 s:shard2 c:collection1) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SolrCore [collection1_shard2_replica_n0] Registered new searcher Searcher@59c0d9db[collection1_shard2_replica_n0] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 329366 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 329366 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 329366 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:62049/pq/collection1_shard2_replica_n0/
[junit4] 2> 329366 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 329366 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SyncStrategy http://127.0.0.1:62049/pq/collection1_shard2_replica_n0/ has no replicas
[junit4] 2> 329366 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 329371 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:62049/pq/collection1_shard2_replica_n0/ shard2
[junit4] 2> 329491 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 329494 INFO (qtp1053861804-2457) [n:127.0.0.1:62049_pq c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n0&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1387
[junit4] 2> 329499 INFO (qtp1053861804-2456) [n:127.0.0.1:62049_pq ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:62049_pq&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1400
[junit4] 2> 329969 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-2-001 of type NRT
[junit4] 2> 329969 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 329971 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5d286294{/pq,null,AVAILABLE}
[junit4] 2> 329971 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@35067d66{HTTP/1.1,[http/1.1]}{127.0.0.1:62059}
[junit4] 2> 329971 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server Started @333573ms
[junit4] 2> 329972 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/pq, hostPort=62059, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-2-001/cores}
[junit4] 2> 329973 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 329974 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 329974 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 329974 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 329974 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T06:03:05.189Z
[junit4] 2> 329984 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 329984 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-2-001/solr.xml
[junit4] 2> 329991 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 329996 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62031/solr
[junit4] 2> 330017 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62059_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 330022 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62059_pq ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 330026 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62059_pq ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62059_pq
[junit4] 2> 330029 INFO (zkCallback-386-thread-1-processing-n:127.0.0.1:62049_pq) [n:127.0.0.1:62049_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 330030 INFO (zkCallback-392-thread-1-processing-n:127.0.0.1:62059_pq) [n:127.0.0.1:62059_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 330029 INFO (zkCallback-374-thread-1-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 330029 INFO (zkCallback-381-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 330108 INFO (OverseerCollectionConfigSetProcessor-98265162004037636-127.0.0.1:62035_pq-n_0000000000) [n:127.0.0.1:62035_pq ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 330144 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62059_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 330149 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62059_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 330149 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62059_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 330151 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62059_pq ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-2-001/cores
[junit4] 2> 330191 INFO (qtp1053861804-2458) [n:127.0.0.1:62049_pq ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:62059_pq&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 330195 INFO (OverseerThreadFactory-977-thread-4-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:62059_pq for creating new replica
[junit4] 2> 330199 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n0&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 330199 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 331223 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 331242 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.s.IndexSchema [collection1_shard3_replica_n0] Schema name=test
[junit4] 2> 331326 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 331365 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard3_replica_n0' using configuration from collection collection1, trusted=true
[junit4] 2> 331365 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard3.replica_n0' (registry 'solr.core.collection1.shard3.replica_n0') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 331365 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 331365 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SolrCore [[collection1_shard3_replica_n0] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-2-001/cores/collection1_shard3_replica_n0], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-2-001/cores/collection1_shard3_replica_n0/data/]
[junit4] 2> 331368 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3466218972926834]
[junit4] 2> 331370 WARN (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 331446 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 331446 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 331448 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 331448 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 331450 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 331455 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.s.SolrIndexSearcher Opening [Searcher@6a3d57e5[collection1_shard3_replica_n0] main]
[junit4] 2> 331457 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 331458 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 331460 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 331460 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572242599890124800
[junit4] 2> 331467 INFO (searcherExecutor-1002-thread-1-processing-n:127.0.0.1:62059_pq x:collection1_shard3_replica_n0 s:shard3 c:collection1) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SolrCore [collection1_shard3_replica_n0] Registered new searcher Searcher@6a3d57e5[collection1_shard3_replica_n0] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 331490 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 331491 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 331491 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:62059/pq/collection1_shard3_replica_n0/
[junit4] 2> 331491 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 331491 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SyncStrategy http://127.0.0.1:62059/pq/collection1_shard3_replica_n0/ has no replicas
[junit4] 2> 331491 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 331496 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:62059/pq/collection1_shard3_replica_n0/ shard3
[junit4] 2> 331670 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 331676 INFO (qtp546202330-2486) [n:127.0.0.1:62059_pq c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n0&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1477
[junit4] 2> 331694 INFO (qtp1053861804-2458) [n:127.0.0.1:62049_pq ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:62059_pq&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2} status=0 QTime=1503
[junit4] 2> 332166 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-3-001 of type NRT
[junit4] 2> 332167 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 332169 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@374d4a76{/pq,null,AVAILABLE}
[junit4] 2> 332169 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4f2649b4{HTTP/1.1,[http/1.1]}{127.0.0.1:62069}
[junit4] 2> 332169 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server Started @335770ms
[junit4] 2> 332169 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/tempDir-001/jetty3, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/pq, hostPort=62069, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-3-001/cores}
[junit4] 2> 332170 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 332171 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 332171 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 332171 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 332171 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T06:03:07.386Z
[junit4] 2> 332175 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 332175 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-3-001/solr.xml
[junit4] 2> 332183 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 332188 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62031/solr
[junit4] 2> 332198 INFO (OverseerCollectionConfigSetProcessor-98265162004037636-127.0.0.1:62035_pq-n_0000000000) [n:127.0.0.1:62035_pq ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 332204 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62069_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 332209 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62069_pq ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 332213 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62069_pq ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62069_pq
[junit4] 2> 332215 INFO (zkCallback-374-thread-1-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 332216 INFO (zkCallback-392-thread-1-processing-n:127.0.0.1:62059_pq) [n:127.0.0.1:62059_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 332216 INFO (zkCallback-386-thread-1-processing-n:127.0.0.1:62049_pq) [n:127.0.0.1:62049_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 332216 INFO (zkCallback-381-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 332217 INFO (zkCallback-398-thread-1-processing-n:127.0.0.1:62069_pq) [n:127.0.0.1:62069_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 332334 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62069_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 332340 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62069_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 332340 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62069_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 332342 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62069_pq ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-3-001/cores
[junit4] 2> 332390 INFO (qtp1053861804-2459) [n:127.0.0.1:62049_pq ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:62069_pq&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 332394 INFO (OverseerThreadFactory-977-thread-5-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:62069_pq for creating new replica
[junit4] 2> 332398 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n0&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 332399 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 333425 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 333438 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.IndexSchema [collection1_shard1_replica_n0] Schema name=test
[junit4] 2> 333549 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 333575 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n0' using configuration from collection collection1, trusted=true
[junit4] 2> 333576 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n0' (registry 'solr.core.collection1.shard1.replica_n0') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 333576 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 333576 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrCore [[collection1_shard1_replica_n0] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-3-001/cores/collection1_shard1_replica_n0], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-3-001/cores/collection1_shard1_replica_n0/data/]
[junit4] 2> 333579 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3466218972926834]
[junit4] 2> 333584 WARN (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 333673 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 333673 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 333675 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 333675 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 333676 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 333676 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.SolrIndexSearcher Opening [Searcher@47967d36[collection1_shard1_replica_n0] main]
[junit4] 2> 333678 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 333679 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 333680 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 333680 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572242602217963520
[junit4] 2> 333680 INFO (searcherExecutor-1013-thread-1-processing-n:127.0.0.1:62069_pq x:collection1_shard1_replica_n0 s:shard1 c:collection1) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrCore [collection1_shard1_replica_n0] Registered new searcher Searcher@47967d36[collection1_shard1_replica_n0] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 333694 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 333694 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 333694 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:62069/pq/collection1_shard1_replica_n0/
[junit4] 2> 333694 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 333694 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SyncStrategy http://127.0.0.1:62069/pq/collection1_shard1_replica_n0/ has no replicas
[junit4] 2> 333695 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 333702 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:62069/pq/collection1_shard1_replica_n0/ shard1
[junit4] 2> 333876 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 333888 INFO (qtp145998174-2515) [n:127.0.0.1:62069_pq c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n0&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1490
[junit4] 2> 333892 INFO (qtp1053861804-2459) [n:127.0.0.1:62049_pq ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:62069_pq&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1501
[junit4] 2> 334142 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-4-001 of type NRT
[junit4] 2> 334142 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 334144 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@62415761{/pq,null,AVAILABLE}
[junit4] 2> 334144 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@a57757e{HTTP/1.1,[http/1.1]}{127.0.0.1:62074}
[junit4] 2> 334144 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server Started @337745ms
[junit4] 2> 334144 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/tempDir-001/jetty4, solrconfig=solrconfig.xml, hostContext=/pq, hostPort=62074, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-4-001/cores}
[junit4] 2> 334144 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 334145 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 334145 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 334145 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 334145 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T06:03:09.360Z
[junit4] 2> 334149 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 334149 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-4-001/solr.xml
[junit4] 2> 334156 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 334159 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62031/solr
[junit4] 2> 334172 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62074_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 334176 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62074_pq ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 334179 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62074_pq ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62074_pq
[junit4] 2> 334182 INFO (zkCallback-386-thread-1-processing-n:127.0.0.1:62049_pq) [n:127.0.0.1:62049_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 334182 INFO (zkCallback-404-thread-1-processing-n:127.0.0.1:62074_pq) [n:127.0.0.1:62074_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 334182 INFO (zkCallback-381-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 334182 INFO (zkCallback-398-thread-1-processing-n:127.0.0.1:62069_pq) [n:127.0.0.1:62069_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 334182 INFO (zkCallback-374-thread-1-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 334182 INFO (zkCallback-392-thread-1-processing-n:127.0.0.1:62059_pq) [n:127.0.0.1:62059_pq ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 334253 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62074_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 334257 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62074_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 334257 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62074_pq ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 334258 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [n:127.0.0.1:62074_pq ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-4-001/cores
[junit4] 2> 334303 INFO (qtp1053861804-2460) [n:127.0.0.1:62049_pq ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:62074_pq&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 334306 INFO (OverseerThreadFactory-977-thread-5-processing-n:127.0.0.1:62035_pq) [n:127.0.0.1:62035_pq ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:62074_pq for creating new replica
[junit4] 2> 334306 INFO (OverseerCollectionConfigSetProcessor-98265162004037636-127.0.0.1:62035_pq-n_0000000000) [n:127.0.0.1:62035_pq ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 334309 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n1&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 334310 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 335336 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 335347 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.s.IndexSchema [collection1_shard2_replica_n1] Schema name=test
[junit4] 2> 335401 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 335424 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n1' using configuration from collection collection1, trusted=true
[junit4] 2> 335425 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n1' (registry 'solr.core.collection1.shard2.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4d00eeda
[junit4] 2> 335425 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 335425 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.c.SolrCore [[collection1_shard2_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-4-001/cores/collection1_shard2_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-4-001/cores/collection1_shard2_replica_n1/data/]
[junit4] 2> 335427 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=49, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=false, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.3466218972926834]
[junit4] 2> 335429 WARN (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 335484 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 335484 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 335485 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 335485 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 335486 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.LogByteSizeMergePolicy: [LogByteSizeMergePolicy: minMergeSize=1677721, mergeFactor=35, maxMergeSize=2147483648, maxMergeSizeForForcedMerge=9223372036854775807, calibrateSizeByDeletes=true, maxMergeDocs=2147483647, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=1.0]
[junit4] 2> 335486 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@308b6f24[collection1_shard2_replica_n1] main]
[junit4] 2> 335487 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 335488 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 335488 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 335488 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572242604113788928
[junit4] 2> 335490 INFO (searcherExecutor-1024-thread-1-processing-n:127.0.0.1:62074_pq x:collection1_shard2_replica_n1 s:shard2 c:collection1) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.c.SolrCore [collection1_shard2_replica_n1] Registered new searcher Searcher@308b6f24[collection1_shard2_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 335492 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.c.ZkController Core needs to recover:collection1_shard2_replica_n1
[junit4] 2> 335493 INFO (updateExecutor-401-thread-1-processing-n:127.0.0.1:62074_pq x:collection1_shard2_replica_n1 s:shard2 c:collection1) [n:127.0.0.1:62074_pq c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n1] o.a.s.u.DefaultSolrCoreState Running recovery
[junit4] 2> 335494 INFO (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:62074_pq x:collection1_shard2_replica_n1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:62074_pq c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n1] o.a.s.c.RecoveryStrategy Starting recovery process. recoveringAfterStartup=true
[junit4] 2> 335494 INFO (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:62074_pq x:collection1_shard2_replica_n1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:62074_pq c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n1] o.a.s.c.RecoveryStrategy ###### startupVersions=[[]]
[junit4] 2> 335494 INFO (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:62074_pq x:collection1_shard2_replica_n1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:62074_pq c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n1] o.a.s.c.RecoveryStrategy Begin buffering updates. core=[collection1_shard2_replica_n1]
[junit4] 2> 335494 INFO (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:62074_pq x:collection1_shard2_replica_n1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:62074_pq c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n1] o.a.s.u.UpdateLog Starting to buffer updates. FSUpdateLog{state=ACTIVE, tlog=null}
[junit4] 2> 335494 INFO (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:62074_pq x:collection1_shard2_replica_n1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:62074_pq c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n1] o.a.s.c.RecoveryStrategy Publishing state of core [collection1_shard2_replica_n1] as recovering, leader is [http://127.0.0.1:62049/pq/collection1_shard2_replica_n0/] and I am [http://127.0.0.1:62074/pq/collection1_shard2_replica_n1/]
[junit4] 2> 335495 INFO (qtp2002985740-2544) [n:127.0.0.1:62074_pq c:collection1 s:shard2 x:collection1_shard2_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n1&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1185
[junit4] 2> 335498 INFO (qtp1053861804-2460) [n:127.0.0.1:62049_pq ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:62074_pq&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1195
[junit4] 2> 335498 INFO (recoveryExecutor-402-thread-1-processing-n:127.0.0.1:62074_pq x:collection1_shard2_replica_n1 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:62074_pq c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n1] o.a.s.c.RecoveryStrategy Sending prep recovery command to [http://127.0.0.1:62049/pq]; [WaitForState: action=PREPRECOVERY&core=collection1_shard2_replica_n0&nodeName=127.0.0.1:62074_pq&coreNodeName=core_node4&state=recovering&checkLive=true&onlyIfLeader=true&onlyIfLeaderActive=true]
[junit4] 2> 335500 INFO (qtp1053861804-2461) [n:127.0.0.1:62049_pq ] o.a.s.h.a.PrepRecoveryOp Going to wait for coreNodeName: core_node4, state: recovering, checkLive: true, onlyIfLeader: true, onlyIfLeaderActive: true, maxTime: 183 s
[junit4] 2> 335500 INFO (qtp1053861804-2461) [n:127.0.0.1:62049_pq ] o.a.s.h.a.PrepRecoveryOp In WaitForState(recovering): collection=collection1, shard=shard2, thisCore=collection1_shard2_replica_n0, leaderDoesNotNeedRecovery=false, isLeader? true, live=true, checkLive=true, currentState=down, localState=active, nodeName=127.0.0.1:62074_pq, coreNodeName=core_node4, onlyIfActiveCheckResult=false, nodeProps: core_node4:{"core":"collection1_shard2_replica_n1","base_url":"http://127.0.0.1:62074/pq","node_name":"127.0.0.1:62074_pq","state":"down","type":"NRT"}
[junit4] 2> 335797 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 5 in directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-5-001 of type NRT
[junit4] 2> 335798 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 335799 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2d0e053a{/pq,null,AVAILABLE}
[junit4] 2> 335799 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@43356af8{HTTP/1.1,[http/1.1]}{127.0.0.1:62082}
[junit4] 2> 335799 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.e.j.s.Server Started @339400ms
[junit4] 2> 335799 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[B25CCE85E23EA6A1]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/tempDir-001/jetty5, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/pq, hostPort=62082, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_B25CCE85E23EA6A1-001/shard-5-001/cores}
[junit4] 2> 335800 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-s
[...truncated too long message...]
ryZkTest, TestLeaderElectionWithEmptyReplica, TestLRUStatsCache, SimpleCollectionCreateDeleteTest, PrimitiveFieldTypeTest, TestTolerantSearch, SparseHLLTest, TestTolerantUpdateProcessorRandomCloud, TestStressReorder, TestSchemaManager, TestPayloadScoreQParserPlugin, TestDelegationWithHadoopAuth, TestPhraseSuggestions, TestAuthorizationFramework, HardAutoCommitTest, HdfsRestartWhileUpdatingTest, TestBulkSchemaConcurrent, UUIDUpdateProcessorFallbackTest, TestSolrCloudWithHadoopAuthPlugin, SearchHandlerTest, TestSchemaNameResource, TestReRankQParserPlugin, TestRestManager, SolrCoreMetricManagerTest, TestPHPSerializedResponseWriter, TestHighlightDedupGrouping, DocExpirationUpdateProcessorFactoryTest, DistributedSpellCheckComponentTest, TestReplicationHandlerBackup, RegexBoostProcessorTest, AtomicUpdateProcessorFactoryTest, PeerSyncReplicationTest, ZkStateReaderTest, TestSchemaSimilarityResource, TestSolrFieldCacheBean, DistributedFacetPivotWhiteBoxTest, TestEmbeddedSolrServerSchemaAPI, NotRequiredUniqueKeyTest, ClusterStateUpdateTest, RollingRestartTest, TestConfigReload, TestMacroExpander, TestPivotHelperCode, TestPseudoReturnFields, BinaryUpdateRequestHandlerTest, PeerSyncWithIndexFingerprintCachingTest, CreateCollectionCleanupTest, TestCursorMarkWithoutUniqueKey, SolrInfoBeanTest, TestNumericTerms64, DistributedFacetPivotLargeTest, ResponseHeaderTest, ReplicaListTransformerTest, TestJsonRequest, XsltUpdateRequestHandlerTest, ZkCLITest, ExplicitHLLTest, HdfsCollectionsAPIDistributedZkTest, TestIntervalFaceting, DocValuesTest, BasicAuthStandaloneTest, ZkControllerTest, TestDynamicFieldCollectionResource, TestSolrCloudWithDelegationTokens, TestManagedSchemaThreadSafety, TestXIncludeConfig, SpatialHeatmapFacetsTest, HdfsChaosMonkeyNothingIsSafeTest, SimplePostToolTest, TestCollectionAPI, TestExtendedDismaxParser, DistributedFacetPivotSmallAdvancedTest, SpellCheckCollatorWithCollapseTest, TestGraphTermsQParserPlugin, QueryParsingTest, ChaosMonkeyNothingIsSafeTest, LeaderInitiatedRecoveryOnShardRestartTest, SoftAutoCommitTest, MissingSegmentRecoveryTest, TestSolrDeletionPolicy2, TestUtils, TestRandomCollapseQParserPlugin, TestCollectionAPIs, HdfsUnloadDistributedZkTest, TestDistribDocBasedVersion, TestUnifiedSolrHighlighter, AliasIntegrationTest, TestSolr4Spatial2, AutoScalingHandlerTest, DeleteShardTest, NoCacheHeaderTest, SaslZkACLProviderTest, OverseerTest, TestOnReconnectListenerSupport, TriLevelCompositeIdRoutingTest, NumericFieldsTest, TestInitQParser, TestImplicitCoreProperties, DateMathParserTest, SuggesterTest, TestFieldSortValues, TestDocBasedVersionConstraints, TestExclusionRuleCollectionAccess, TestStressInPlaceUpdates, PrimUtilsTest, TestShortCircuitedRequests, TestSQLHandlerNonCloud, SolrCoreTest, AnalyticsMergeStrategyTest, TestSerializedLuceneMatchVersion, TestRuleBasedAuthorizationPlugin, URLClassifyProcessorTest, TestDFRSimilarityFactory, TestExportWriter, TestManagedResource, UniqFieldsUpdateProcessorFactoryTest, HdfsLockFactoryTest, SolrMetricReporterTest, TestRTimerTree, TestCloudInspectUtil, SliceStateTest, ReplicationFactorTest, TestInPlaceUpdatesStandalone, SubstringBytesRefFilterTest, TestConfigSetsAPIExclusivity, SolrGangliaReporterTest, CdcrUpdateLogTest, LeaderElectionTest, TestSubQueryTransformerCrossCore, BasicDistributedZkTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, ShardRoutingTest, ZkSolrClientTest, TestRandomDVFaceting, TestFaceting, TestRecovery, TestHashPartitioner, TermVectorComponentDistributedTest, TestRealTimeGet, TestStressVersions, DistributedTermsComponentTest, TestGroupingSearch, TestSort, TestFunctionQuery, TestLazyCores, SuggesterFSTTest, CoreAdminHandlerTest, SuggesterTSTTest, TestStressLucene, SpatialFilterTest, SuggesterWFSTTest, WordBreakSolrSpellCheckerTest, TestUpdate, FieldMutatingUpdateProcessorTest, TestAtomicUpdateErrorCases, DefaultValueUpdateProcessorTest, DistanceFunctionTest, IndexBasedSpellCheckerTest, DisMaxRequestHandlerTest, TestReversedWildcardFilterFactory, FileBasedSpellCheckerTest, RequestHandlersTest, TestValueSourceCache, TermVectorComponentTest, RequiredFieldsTest, TestSolrQueryParser, IndexSchemaRuntimeFieldTest, IndexSchemaTest, UpdateRequestProcessorFactoryTest, TestCSVResponseWriter, TestAnalyzedSuggestions, CSVRequestHandlerTest, TestComponentsName, SearchHandlerTest, TestQuerySenderNoQuery, ResponseLogComponentTest, TestStressRecovery, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CollectionsAPIAsyncDistributedZkTest, ConcurrentDeleteAndCreateCollectionTest, ConnectionManagerTest, CustomCollectionTest, DistribDocExpirationUpdateProcessorTest, LeaderElectionContextKeyTest, LeaderFailureAfterFreshStartTest, LeaderInitiatedRecoveryOnCommitTest, MigrateRouteKeyTest, MoveReplicaTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverriddenZkACLAndCredentialsProvidersTest, OverseerCollectionConfigSetProcessorTest, OverseerModifyCollectionTest, OverseerTaskQueueTest, RemoteQueryErrorTest, ReplaceNodeTest, SolrXmlInZkTest, TestAuthenticationFramework, TestCloudDeleteByQuery, TestCloudJSONFacetJoinDomain, TestCloudPseudoReturnFields, TestCryptoKeys, TestLockTree, TestMiniSolrCloudCluster]
[junit4] Completed [592/727 (3!)] on J0 in 410.58s, 3 tests, 2 failures <<< FAILURES!
[...truncated 361 lines...]
ERROR: command execution failed.
Archiving artifacts
ERROR: Failed to archive artifacts: **/*.events,heapdumps/**,**/*_pid*.log
java.io.EOFException
at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:59)
Caused: java.io.IOException: Unexpected termination of the channel
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:73)
Caused: hudson.remoting.ChannelClosedException: channel is already closed
at hudson.remoting.Channel.send(Channel.java:605)
at hudson.remoting.Request.call(Request.java:130)
at hudson.remoting.Channel.call(Channel.java:829)
at hudson.FilePath.act(FilePath.java:987)
Caused: java.io.IOException: remote file operation failed: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX at hudson.remoting.Channel@479930c9:MacOSX VBOX
at hudson.FilePath.act(FilePath.java:994)
at hudson.FilePath.act(FilePath.java:976)
at hudson.tasks.ArtifactArchiver.perform(ArtifactArchiver.java:242)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:730)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:676)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:621)
at hudson.model.Run.execute(Run.java:1760)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:415)
[WARNINGS] Skipping publisher since build result is FAILURE
Recording test results
ERROR: Step ‘Publish JUnit test result report’ aborted due to exception:
java.io.EOFException
at java.io.ObjectInputStream$PeekInputStream.readFully(ObjectInputStream.java:2638)
at java.io.ObjectInputStream$BlockDataInputStream.readShort(ObjectInputStream.java:3113)
at java.io.ObjectInputStream.readStreamHeader(ObjectInputStream.java:853)
at java.io.ObjectInputStream.<init>(ObjectInputStream.java:349)
at hudson.remoting.ObjectInputStreamEx.<init>(ObjectInputStreamEx.java:48)
at hudson.remoting.AbstractSynchronousByteArrayCommandTransport.read(AbstractSynchronousByteArrayCommandTransport.java:34)
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:59)
Caused: java.io.IOException: Unexpected termination of the channel
at hudson.remoting.SynchronousCommandTransport$ReaderThread.run(SynchronousCommandTransport.java:73)
Caused: hudson.remoting.ChannelClosedException: channel is already closed
at hudson.remoting.Channel.send(Channel.java:605)
at hudson.remoting.Request.call(Request.java:130)
at hudson.remoting.Channel.call(Channel.java:829)
at hudson.FilePath.act(FilePath.java:987)
Caused: java.io.IOException: remote file operation failed: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX at hudson.remoting.Channel@479930c9:MacOSX VBOX
at hudson.FilePath.act(FilePath.java:994)
at hudson.FilePath.act(FilePath.java:976)
at hudson.tasks.junit.JUnitParser.parseResult(JUnitParser.java:103)
at hudson.tasks.junit.JUnitResultArchiver.parse(JUnitResultArchiver.java:128)
at hudson.tasks.junit.JUnitResultArchiver.perform(JUnitResultArchiver.java:149)
at hudson.tasks.BuildStepCompatibilityLayer.perform(BuildStepCompatibilityLayer.java:81)
at hudson.tasks.BuildStepMonitor$1.perform(BuildStepMonitor.java:20)
at hudson.model.AbstractBuild$AbstractBuildExecution.perform(AbstractBuild.java:730)
at hudson.model.AbstractBuild$AbstractBuildExecution.performAllBuildSteps(AbstractBuild.java:676)
at hudson.model.Build$BuildExecution.post2(Build.java:186)
at hudson.model.AbstractBuild$AbstractBuildExecution.post(AbstractBuild.java:621)
at hudson.model.Run.execute(Run.java:1760)
at hudson.model.FreeStyleBuild.run(FreeStyleBuild.java:43)
at hudson.model.ResourceController.execute(ResourceController.java:97)
at hudson.model.Executor.run(Executor.java:415)
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 18 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/18/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseG1GC
23 tests failed.
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Could not find collection:collection2
Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:44EBD28F88E03B2A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:907)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:612)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestConfigSetsAPI.testUploadWithScriptUpdateProcessor
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:A3E0F12A3D2DF524]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.TestConfigSetsAPI.testUploadWithScriptUpdateProcessor(TestConfigSetsAPI.java:363)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestConfigSetsAPI.testUploadWithRunExecutableListener
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:15DBAB5DAB700B23]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.TestConfigSetsAPI.testUploadWithRunExecutableListener(TestConfigSetsAPI.java:338)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.core.SolrCoreCheckLockOnStartupTest.testSimpleLockErrorOnStartup
Error Message:
Expected LockObtainFailedException
Stack Trace:
java.lang.AssertionError: Expected LockObtainFailedException
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:E544871C3793AA60]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.core.SolrCoreCheckLockOnStartupTest.testSimpleLockErrorOnStartup(SolrCoreCheckLockOnStartupTest.java:66)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.core.SolrCoreCheckLockOnStartupTest.testNativeLockErrorOnStartup
Error Message:
Expected LockObtainFailedException
Stack Trace:
java.lang.AssertionError: Expected LockObtainFailedException
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:45921ED502C8CB0E]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.core.SolrCoreCheckLockOnStartupTest.testNativeLockErrorOnStartup(SolrCoreCheckLockOnStartupTest.java:93)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.core.TestBadConfig.testInvalidScriptFile
Error Message:
Did not encounter any exception from: bad-solrconfig-invalid-scriptfile.xml using schema.xml
Stack Trace:
java.lang.AssertionError: Did not encounter any exception from: bad-solrconfig-invalid-scriptfile.xml using schema.xml
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:D2AE7AE0BED39860]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:73)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:35)
at org.apache.solr.core.TestBadConfig.testInvalidScriptFile(TestBadConfig.java:74)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.core.TestBadConfig.testTolerantUpdateProcessorNoUniqueKey
Error Message:
Did not encounter any exception from: solrconfig-tolerant-update-minimal.xml using schema-minimal.xml
Stack Trace:
java.lang.AssertionError: Did not encounter any exception from: solrconfig-tolerant-update-minimal.xml using schema-minimal.xml
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:4AC219DEC97297A4]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:73)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:35)
at org.apache.solr.core.TestBadConfig.testTolerantUpdateProcessorNoUniqueKey(TestBadConfig.java:99)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.core.TestBadConfig.testUpdateLogButNoVersionField
Error Message:
Did not encounter any exception from: solrconfig.xml using schema12.xml
Stack Trace:
java.lang.AssertionError: Did not encounter any exception from: solrconfig.xml using schema12.xml
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:E8FF1E8612686E72]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:73)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:35)
at org.apache.solr.core.TestBadConfig.testUpdateLogButNoVersionField(TestBadConfig.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.core.TestBadConfig.testMissingScriptFile
Error Message:
Did not encounter any exception from: bad-solrconfig-missing-scriptfile.xml using schema.xml
Stack Trace:
java.lang.AssertionError: Did not encounter any exception from: bad-solrconfig-missing-scriptfile.xml using schema.xml
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:65B9696C6C4FA325]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:73)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:35)
at org.apache.solr.core.TestBadConfig.testMissingScriptFile(TestBadConfig.java:67)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.core.TestBadConfig.testBogusMergePolicy
Error Message:
Did not encounter any exception from: bad-mpf-solrconfig.xml using schema-minimal.xml
Stack Trace:
java.lang.AssertionError: Did not encounter any exception from: bad-mpf-solrconfig.xml using schema-minimal.xml
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:20C8B3A08CD8C446]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:73)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:35)
at org.apache.solr.core.TestBadConfig.testBogusMergePolicy(TestBadConfig.java:79)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.core.TestBadConfig.testBogusScriptEngine
Error Message:
Did not encounter any exception from: bad-solrconfig-bogus-scriptengine-name.xml using schema.xml
Stack Trace:
java.lang.AssertionError: Did not encounter any exception from: bad-solrconfig-bogus-scriptengine-name.xml using schema.xml
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:7D427AF90DD79B84]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:73)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:35)
at org.apache.solr.core.TestBadConfig.testBogusScriptEngine(TestBadConfig.java:60)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.admin.CoreAdminHandlerTest.testCoreAdminHandler
Error Message:
org/apache/solr/core/CoreContainer$CoreLoadFailure
Stack Trace:
java.lang.NoClassDefFoundError: org/apache/solr/core/CoreContainer$CoreLoadFailure
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:4D7FD06D49925B2C]:0)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:983)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
at org.apache.solr.handler.admin.CoreAdminHandler.handleRequestBody(CoreAdminHandler.java:174)
at org.apache.solr.handler.admin.CoreAdminHandlerTest.testCoreAdminHandler(CoreAdminHandlerTest.java:140)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.admin.CoreAdminHandlerTest.testDeleteInstanceDirAfterCreateFailure
Error Message:
The data directory was not cleaned up on unload after a failed core reload
Stack Trace:
java.lang.AssertionError: The data directory was not cleaned up on unload after a failed core reload
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:B7764F19053E84D3]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.handler.admin.CoreAdminHandlerTest.testDeleteInstanceDirAfterCreateFailure(CoreAdminHandlerTest.java:374)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.handler.admin.TestApiFramework.testFramework
Error Message:
Mockito cannot mock this class: class org.apache.solr.core.CoreContainer. Mockito can only mock non-private & non-final classes. If you're not sure why you're getting this error, please report to the mailing list. Java : 1.8 JVM vendor name : Oracle Corporation JVM vendor version : 25.131-b11 JVM name : Java HotSpot(TM) 64-Bit Server VM JVM version : 1.8.0_131-b11 JVM info : mixed mode OS name : Mac OS X OS version : 10.11.6 Underlying exception : java.lang.IllegalStateException: Error invoking java.lang.reflect.AnnotatedParameterizedType#getAnnotatedActualTypeArguments
Stack Trace:
org.mockito.exceptions.base.MockitoException:
Mockito cannot mock this class: class org.apache.solr.core.CoreContainer.
Mockito can only mock non-private & non-final classes.
If you're not sure why you're getting this error, please report to the mailing list.
Java : 1.8
JVM vendor name : Oracle Corporation
JVM vendor version : 25.131-b11
JVM name : Java HotSpot(TM) 64-Bit Server VM
JVM version : 1.8.0_131-b11
JVM info : mixed mode
OS name : Mac OS X
OS version : 10.11.6
Underlying exception : java.lang.IllegalStateException: Error invoking java.lang.reflect.AnnotatedParameterizedType#getAnnotatedActualTypeArguments
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:DBC9277220C8BAEF]:0)
at org.apache.solr.handler.admin.TestCoreAdminApis.getCoreContainerMock(TestCoreAdminApis.java:73)
at org.apache.solr.handler.admin.TestApiFramework.testFramework(TestApiFramework.java:59)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.lang.IllegalStateException: Error invoking java.lang.reflect.AnnotatedParameterizedType#getAnnotatedActualTypeArguments
at net.bytebuddy.description.type.TypeDescription$Generic$AnnotationReader$ForTypeArgument.resolve(TypeDescription.java:3271)
at net.bytebuddy.description.type.TypeDescription$Generic$AnnotationReader$Delegator$Chained.resolve(TypeDescription.java:3052)
at net.bytebuddy.description.type.TypeDescription$Generic$AnnotationReader$ForTypeArgument.resolve(TypeDescription.java:3238)
at net.bytebuddy.description.type.TypeDescription$Generic$AnnotationReader$Delegator.asList(TypeDescription.java:3006)
at net.bytebuddy.description.type.TypeDescription$Generic$OfNonGenericType$ForLoadedType.getDeclaredAnnotations(TypeDescription.java:3566)
at net.bytebuddy.implementation.attribute.AnnotationAppender$ForTypeAnnotations.apply(AnnotationAppender.java:639)
at net.bytebuddy.implementation.attribute.AnnotationAppender$ForTypeAnnotations.onNonGenericType(AnnotationAppender.java:620)
at net.bytebuddy.implementation.attribute.AnnotationAppender$ForTypeAnnotations.onNonGenericType(AnnotationAppender.java:333)
at net.bytebuddy.description.type.TypeDescription$Generic$OfNonGenericType.accept(TypeDescription.java:3433)
at net.bytebuddy.implementation.attribute.AnnotationAppender$ForTypeAnnotations.onParameterizedType(AnnotationAppender.java:601)
at net.bytebuddy.implementation.attribute.AnnotationAppender$ForTypeAnnotations.onParameterizedType(AnnotationAppender.java:333)
at net.bytebuddy.description.type.TypeDescription$Generic$OfParameterizedType.accept(TypeDescription.java:4356)
at net.bytebuddy.implementation.attribute.MethodAttributeAppender$ForInstrumentedMethod.apply(MethodAttributeAppender.java:171)
at net.bytebuddy.implementation.attribute.MethodAttributeAppender$Compound.apply(MethodAttributeAppender.java:425)
at net.bytebuddy.dynamic.scaffold.TypeWriter$MethodPool$Record$ForDefinedMethod$WithBody.applyAttributes(TypeWriter.java:609)
at net.bytebuddy.dynamic.scaffold.TypeWriter$MethodPool$Record$ForDefinedMethod$WithBody.applyBody(TypeWriter.java:601)
at net.bytebuddy.dynamic.scaffold.TypeWriter$MethodPool$Record$ForDefinedMethod.apply(TypeWriter.java:521)
at net.bytebuddy.dynamic.scaffold.TypeWriter$Default$ForCreation.create(TypeWriter.java:4089)
at net.bytebuddy.dynamic.scaffold.TypeWriter$Default.make(TypeWriter.java:1612)
at net.bytebuddy.dynamic.scaffold.subclass.SubclassDynamicTypeBuilder.make(SubclassDynamicTypeBuilder.java:174)
at net.bytebuddy.dynamic.scaffold.subclass.SubclassDynamicTypeBuilder.make(SubclassDynamicTypeBuilder.java:155)
at net.bytebuddy.dynamic.DynamicType$Builder$AbstractBase.make(DynamicType.java:2536)
at net.bytebuddy.dynamic.DynamicType$Builder$AbstractBase$Delegator.make(DynamicType.java:2638)
at org.mockito.internal.creation.bytebuddy.SubclassBytecodeGenerator.mockClass(SubclassBytecodeGenerator.java:94)
at org.mockito.internal.creation.bytebuddy.TypeCachingBytecodeGenerator$1.call(TypeCachingBytecodeGenerator.java:35)
at org.mockito.internal.creation.bytebuddy.TypeCachingBytecodeGenerator$1.call(TypeCachingBytecodeGenerator.java:32)
at net.bytebuddy.TypeCache.findOrInsert(TypeCache.java:138)
at net.bytebuddy.TypeCache$WithInlineExpunction.findOrInsert(TypeCache.java:346)
at net.bytebuddy.TypeCache.findOrInsert(TypeCache.java:161)
at net.bytebuddy.TypeCache$WithInlineExpunction.findOrInsert(TypeCache.java:355)
at org.mockito.internal.creation.bytebuddy.TypeCachingBytecodeGenerator.mockClass(TypeCachingBytecodeGenerator.java:30)
at org.mockito.internal.creation.bytebuddy.SubclassByteBuddyMockMaker.createMockType(SubclassByteBuddyMockMaker.java:71)
at org.mockito.internal.creation.bytebuddy.SubclassByteBuddyMockMaker.createMock(SubclassByteBuddyMockMaker.java:42)
at org.mockito.internal.creation.bytebuddy.ByteBuddyMockMaker.createMock(ByteBuddyMockMaker.java:26)
at org.mockito.internal.util.MockUtil.createMock(MockUtil.java:35)
at org.mockito.internal.MockitoCore.mock(MockitoCore.java:65)
at org.mockito.Mockito.mock(Mockito.java:1681)
at org.mockito.Mockito.mock(Mockito.java:1594)
... 41 more
Caused by: java.lang.NoClassDefFoundError: org/apache/solr/core/CoreContainer$CoreLoadFailure
at java.lang.Class.getDeclaringClass0(Native Method)
at java.lang.Class.getDeclaringClass(Class.java:1235)
at java.lang.Class.getEnclosingClass(Class.java:1277)
at sun.reflect.annotation.AnnotatedTypeFactory.addNesting(AnnotatedTypeFactory.java:96)
at sun.reflect.annotation.AnnotatedTypeFactory.buildAnnotatedType(AnnotatedTypeFactory.java:65)
at sun.reflect.annotation.AnnotatedTypeFactory$AnnotatedParameterizedTypeImpl.getAnnotatedActualTypeArguments(AnnotatedTypeFactory.java:255)
at sun.reflect.GeneratedMethodAccessor64.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at net.bytebuddy.description.type.TypeDescription$Generic$AnnotationReader$ForTypeArgument.resolve(TypeDescription.java:3265)
... 78 more
FAILED: org.apache.solr.schema.BadIndexSchemaTest.testPerFieldtypePostingsFormatButNoSchemaCodecFactory
Error Message:
Did not encounter any exception from: solrconfig-basic.xml using bad-schema-codec-global-vs-ft-mismatch.xml
Stack Trace:
java.lang.AssertionError: Did not encounter any exception from: solrconfig-basic.xml using bad-schema-codec-global-vs-ft-mismatch.xml
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:93711E57FFB34339]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:73)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:35)
at org.apache.solr.schema.BadIndexSchemaTest.doTest(BadIndexSchemaTest.java:25)
at org.apache.solr.schema.BadIndexSchemaTest.testPerFieldtypePostingsFormatButNoSchemaCodecFactory(BadIndexSchemaTest.java:130)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.schema.BadIndexSchemaTest.testSimDefaultFieldTypeDoesNotExist
Error Message:
Did not encounter any exception from: solrconfig-basic.xml using bad-schema-sim-default-does-not-exist.xml
Stack Trace:
java.lang.AssertionError: Did not encounter any exception from: solrconfig-basic.xml using bad-schema-sim-default-does-not-exist.xml
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:F1DEEF0040D7A1BF]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:73)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:35)
at org.apache.solr.schema.BadIndexSchemaTest.doTest(BadIndexSchemaTest.java:25)
at org.apache.solr.schema.BadIndexSchemaTest.testSimDefaultFieldTypeDoesNotExist(BadIndexSchemaTest.java:176)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.schema.BadIndexSchemaTest.testSimDefaultFieldTypeHasNoExplicitSim
Error Message:
Did not encounter any exception from: solrconfig-basic.xml using bad-schema-sim-default-has-no-explicit-sim.xml
Stack Trace:
java.lang.AssertionError: Did not encounter any exception from: solrconfig-basic.xml using bad-schema-sim-default-has-no-explicit-sim.xml
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:CB38DEBDA2ABCB3A]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:73)
at org.apache.solr.core.AbstractBadConfigTestBase.assertConfigs(AbstractBadConfigTestBase.java:35)
at org.apache.solr.schema.BadIndexSchemaTest.doTest(BadIndexSchemaTest.java:25)
at org.apache.solr.schema.BadIndexSchemaTest.testSimDefaultFieldTypeHasNoExplicitSim(BadIndexSchemaTest.java:171)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.schema.PreAnalyzedFieldManagedSchemaCloudTest
Error Message:
Captured an uncaught exception in thread: Thread[id=28940, name=Thread-4967, state=RUNNABLE, group=TGRP-PreAnalyzedFieldManagedSchemaCloudTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=28940, name=Thread-4967, state=RUNNABLE, group=TGRP-PreAnalyzedFieldManagedSchemaCloudTest]
Caused by: java.lang.NoClassDefFoundError: org/apache/solr/core/CoreContainer$CoreLoadFailure
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2]:0)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1219)
at org.apache.solr.core.SolrCore.lambda$getConfListener$18(SolrCore.java:2939)
at org.apache.solr.cloud.ZkController.lambda$fireEventListeners$4(ZkController.java:2429)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.schema.PreAnalyzedFieldManagedSchemaCloudTest
Error Message:
Captured an uncaught exception in thread: Thread[id=28941, name=Thread-4968, state=RUNNABLE, group=TGRP-PreAnalyzedFieldManagedSchemaCloudTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=28941, name=Thread-4968, state=RUNNABLE, group=TGRP-PreAnalyzedFieldManagedSchemaCloudTest]
Caused by: java.lang.NoClassDefFoundError: org/apache/solr/core/CoreContainer$CoreLoadFailure
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2]:0)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1219)
at org.apache.solr.core.SolrCore.lambda$getConfListener$18(SolrCore.java:2939)
at org.apache.solr.cloud.ZkController.lambda$fireEventListeners$4(ZkController.java:2429)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.schema.TestManagedSchemaAPI
Error Message:
Captured an uncaught exception in thread: Thread[id=7095, name=Thread-1249, state=RUNNABLE, group=TGRP-TestManagedSchemaAPI]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=7095, name=Thread-1249, state=RUNNABLE, group=TGRP-TestManagedSchemaAPI]
Caused by: java.lang.NoClassDefFoundError: org/apache/solr/core/CoreContainer$CoreLoadFailure
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2]:0)
at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1219)
at org.apache.solr.core.SolrCore.lambda$getConfListener$18(SolrCore.java:2939)
at org.apache.solr.cloud.ZkController.lambda$fireEventListeners$4(ZkController.java:2429)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.MultiThreadedOCPTest.test
Error Message:
Captured an uncaught exception in thread: Thread[id=13565, name=parallelCoreAdminExecutor-4312-thread-6, state=RUNNABLE, group=TGRP-MultiThreadedOCPTest]
Stack Trace:
com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=13565, name=parallelCoreAdminExecutor-4312-thread-6, state=RUNNABLE, group=TGRP-MultiThreadedOCPTest]
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:44EBD28F88E03B2A]:0)
Caused by: java.lang.NoClassDefFoundError: org/apache/solr/core/CoreContainer$CoreLoadFailure
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2]:0)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:983)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:904)
at org.apache.solr.handler.admin.CoreAdminOperation.lambda$static$0(CoreAdminOperation.java:91)
at org.apache.solr.handler.admin.CoreAdminOperation.execute(CoreAdminOperation.java:384)
at org.apache.solr.handler.admin.CoreAdminHandler$CallInfo.call(CoreAdminHandler.java:389)
at org.apache.solr.handler.admin.CoreAdminHandler.lambda$handleRequestBody$0(CoreAdminHandler.java:182)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.core.CoreSorterTest.testSort
Error Message:
Mockito cannot mock this class: class org.apache.solr.core.CoreContainer. Mockito can only mock non-private & non-final classes. If you're not sure why you're getting this error, please report to the mailing list. Java : 1.8 JVM vendor name : Oracle Corporation JVM vendor version : 25.131-b11 JVM name : Java HotSpot(TM) 64-Bit Server VM JVM version : 1.8.0_131-b11 JVM info : mixed mode OS name : Mac OS X OS version : 10.11.6 Underlying exception : java.lang.IllegalStateException: Error invoking java.lang.reflect.AnnotatedParameterizedType#getAnnotatedActualTypeArguments
Stack Trace:
org.mockito.exceptions.base.MockitoException:
Mockito cannot mock this class: class org.apache.solr.core.CoreContainer.
Mockito can only mock non-private & non-final classes.
If you're not sure why you're getting this error, please report to the mailing list.
Java : 1.8
JVM vendor name : Oracle Corporation
JVM vendor version : 25.131-b11
JVM name : Java HotSpot(TM) 64-Bit Server VM
JVM version : 1.8.0_131-b11
JVM info : mixed mode
OS name : Mac OS X
OS version : 10.11.6
Underlying exception : java.lang.IllegalStateException: Error invoking java.lang.reflect.AnnotatedParameterizedType#getAnnotatedActualTypeArguments
at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2:9D5AC57CED514CC2]:0)
at org.apache.solr.core.CoreSorterTest.getMockContainer(CoreSorterTest.java:104)
at org.apache.solr.core.CoreSorterTest.testSort(CoreSorterTest.java:84)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
[...truncated too long message...]
, TestFieldTypeResource, BJQParserTest, TestMiniSolrCloudCluster, UpdateLogTest, SolrIndexMetricsTest, TestInfoStreamLogging, DistribDocExpirationUpdateProcessorTest, SignatureUpdateProcessorFactoryTest, TestMergePolicyConfig, TestClassicSimilarityFactory, BasicDistributedZk2Test, ConcurrentDeleteAndCreateCollectionTest, TestAnalyzedSuggestions, LukeRequestHandlerTest, TestTrie, TestShardHandlerFactory, TestLegacyNumericUtils, TolerantUpdateProcessorTest, CloneFieldUpdateProcessorFactoryTest, DataDrivenBlockJoinTest, TestSimpleTrackingShardHandler, WrapperMergePolicyFactoryTest, TestSQLHandler, TestLegacyNumericRangeQueryBuilder, V2StandaloneTest, TlogReplayBufferedWhileIndexingTest, TestHdfsCloudBackupRestore, RecoveryAfterSoftCommitTest, TestHttpShardHandlerFactory, SolrMetricsIntegrationTest, TestLeaderElectionZkExpiry, TestTrieFacet, MetricUtilsTest, TestConfigOverlay, TestComplexPhraseLeadingWildcard, TestCustomDocTransformer, PingRequestHandlerTest, TestFieldCacheSortRandom, CdcrReplicationDistributedZkTest, SolrRequestParserTest, TestScoreJoinQPScore, CopyFieldTest, CoreAdminRequestStatusTest, SOLR749Test, TestReload, TestTolerantUpdateProcessorCloud, DeleteReplicaTest, TermVectorComponentDistributedTest, ReplaceNodeTest, TestQueryWrapperFilter, FullSolrCloudDistribCmdsTest, TestFieldCacheReopen, RankQueryTest, EnumFieldTest, SuggestComponentContextFilterQueryTest, TestJoin, AddSchemaFieldsUpdateProcessorFactoryTest, DistributedDebugComponentTest, TestMiniSolrCloudClusterSSL, SpatialRPTFieldTypeTest, TestConfigsApi, TestRandomRequestDistribution, PreAnalyzedUpdateProcessorTest, SpellingQueryConverterTest, TestCopyFieldCollectionResource, SolrPluginUtilsTest, HdfsSyncSliceTest, TestCrossCoreJoin, SuggesterFSTTest, VMParamsZkACLAndCredentialsProvidersTest, TestConfigSetsAPI, HdfsBasicDistributedZkTest, TestSearcherReuse, LargeFieldTest, TestOrdValues, TestBM25SimilarityFactory, TestManagedSchemaAPI, TestAnalyzeInfixSuggestions, ConvertedLegacyTest, DistributedFacetExistsSmallTest, BadCopyFieldTest, StatelessScriptUpdateProcessorFactoryTest, OverseerCollectionConfigSetProcessorTest, TestStressLiveNodes, BasicAuthIntegrationTest, TestNoOpRegenerator, TestRawResponseWriter, LoggingHandlerTest, TestCloudDeleteByQuery, MigrateRouteKeyTest, TestDistribIDF, DistributedFacetPivotLongTailTest, ShardRoutingCustomTest, SegmentsInfoRequestHandlerTest, HttpSolrCallGetCoreTest, GraphQueryTest, SolrCLIZkUtilsTest, HdfsWriteToMultipleCollectionsTest, TestFieldResource, TestFilteredDocIdSet, ShufflingReplicaListTransformerTest, ChangedSchemaMergeTest, DistributedQueueTest, TestSolrConfigHandlerCloud, CollectionsAPIAsyncDistributedZkTest, TestDynamicFieldResource, MultiThreadedOCPTest, TestApiFramework, TestQueryTypes, ConnectionManagerTest, TestHighFrequencyDictionaryFactory, TestPolicyCloud, TestDocTermOrds, OpenExchangeRatesOrgProviderTest, LeaderElectionIntegrationTest, TestLuceneMatchVersion, DistributedIntervalFacetingTest, TestFileDictionaryLookup, RequestLoggingTest, TestSolrQueryResponse, DeleteStatusTest, PropertiesRequestHandlerTest, DocValuesMultiTest, UpdateRequestProcessorFactoryTest, TestEmbeddedSolrServerConstructors, DeleteLastCustomShardedReplicaTest, TestRemoteStreaming, FileBasedSpellCheckerTest, TestStandardQParsers, TestConfigSetProperties, HdfsTlogReplayBufferedWhileIndexingTest, TestPayloadCheckQParserPlugin, TestDeleteCollectionOnDownNodes, BigEndianAscendingWordDeserializerTest, HdfsRecoveryZkTest, HdfsChaosMonkeySafeLeaderTest, TermsComponentTest, ExternalFileFieldSortTest, TestPerFieldSimilarity, TestDocSet, SolrGraphiteReporterTest, AutoCommitTest, TestMultiValuedNumericRangeQuery, TestSchemaVersionResource, SpellCheckCollatorTest, CachingDirectoryFactoryTest, DistributedFacetPivotSmallTest, TestFastOutputStream, HttpPartitionTest, TestLMJelinekMercerSimilarityFactory, TestSolrIndexConfig, TestElisionMultitermQuery, TestSolrCoreParser, TestSolrCLIRunExample, TestPostingsSolrHighlighter, LeaderFailoverAfterPartitionTest, HLLUtilTest, DocValuesNotIndexedTest, TestXmlQParserPlugin, TestExceedMaxTermLength, TestSizeLimitedDistributedMap, TemplateUpdateProcessorTest, TestUniqueKeyFieldResource, TestImpersonationWithHadoopAuth, TestValueSourceCache, CustomCollectionTest, UtilsToolTest, TestSha256AuthenticationProvider, BadIndexSchemaTest, SolrCmdDistributorTest, SuggesterTSTTest, TestSolrQueryParser, TestSolrCloudWithKerberosAlt, JsonLoaderTest, ChaosMonkeySafeLeaderTest, CollectionsAPIDistributedZkTest, ClusterStateUpdateTest, TestRandomFaceting, LeaderElectionTest, ZkSolrClientTest, TestDistributedSearch, TestFaceting, TestHashPartitioner, ZkControllerTest, TestRealTimeGet, TestRangeQuery, TestSolr4Spatial, SpellCheckComponentTest, TestGroupingSearch, TestFiltering, TestFunctionQuery, BasicFunctionalityTest, DirectUpdateHandlerTest, TestBadConfig, TestIndexSearcher, DistributedQueryElevationComponentTest, CoreAdminHandlerTest, SuggesterTest, TestStressLucene, TestCSVLoader, PolyFieldTest, WordBreakSolrSpellCheckerTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, FieldMutatingUpdateProcessorTest, TestWordDelimiterFilterFactory, QueryEqualityTest, SolrInfoBeanTest, DebugComponentTest, IndexBasedSpellCheckerTest, TestQueryUtils, DocumentAnalysisRequestHandlerTest, TermVectorComponentTest, RequiredFieldsTest, IndexSchemaRuntimeFieldTest, TestCollationField, MBeansHandlerTest, UniqFieldsUpdateProcessorFactoryTest, CSVRequestHandlerTest, SearchHandlerTest, TestSolrDeletionPolicy2, SampleTest, TestBinaryField, TestSearchPerf, TestConfig, TestFuzzyAnalyzedSuggestions, DirectSolrConnectionTest, TestPhraseSuggestions, TestCharFilters, SynonymTokenizerTest, EchoParamsTest, TestSweetSpotSimilarityFactory, TestFastWriter, ResourceLoaderTest, PluginInfoTest, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, TestSuggestSpellingConverter, DateFieldTest, DOMUtilTest, ClusterStateTest, TestSolrJ, TestLRUCache, TestUtils, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, DistributedMLTComponentTest, TestRTGBase, CursorPagingTest, TestCursorMarkWithoutUniqueKey, TestDistributedMissingSort, TestHighlightDedupGrouping, TestEmbeddedSolrServerSchemaAPI, TestJettySolrRunner, ConnectionReuseTest, ActionThrottleTest, AssignTest, AsyncCallRequestStatusResponseTest, BaseCdcrDistributedZkTest, CdcrReplicationHandlerTest, CdcrRequestHandlerTest, CdcrVersionReplicationTest, CleanupOldIndexTest, CloudExitableDirectoryReaderTest, CollectionReloadTest, CollectionStateFormat2Test, CollectionsAPISolrJTest, DistribJoinFromCollectionTest, LeaderFailureAfterFreshStartTest, LeaderInitiatedRecoveryOnShardRestartTest, MoveReplicaHDFSTest, OutOfBoxZkACLAndCredentialsProvidersTest, OverseerModifyCollectionTest, OverseerRolesTest, OverseerTaskQueueTest, ShardSplitTest, TestPullReplica, TestRandomFlRTGCloud, TestRequestStatusCollectionAPI, TestShortCircuitedRequests, TestStressCloudBlindAtomicUpdates, TriLevelCompositeIdRoutingTest, AutoScalingHandlerTest, HdfsNNFailoverTest, HdfsRecoverLeaseTest, HdfsThreadLeakTest, HdfsUnloadDistributedZkTest, TestClusterStateMutator, ZkStateWriterTest, ImplicitSnitchTest, RuleEngineTest, RulesTest, BlobRepositoryCloudTest, ConfigureRecoveryStrategyTest, CoreSorterTest, DirectoryFactoryTest, ExitableDirectoryReaderTest, QueryResultKeyTest, TestBackupRepositoryFactory, TestConfigSetImmutable, TestCorePropertiesReload, TestDynamicLoading, TestSolrCloudSnapshots, TestConfigReload, TestSystemCollAutoCreate, DistributedQueryComponentCustomSortTest, DistributedSuggestComponentTest, TestDistributedStatsComponentCardinality, TestPivotHelperCode, TestTrackingShardHandlerFactory, SolrMetricManagerTest, SolrMetricReporterTest, SolrSlf4jReporterTest, SolrShardReporterTest, TestJavabinTupleStreamParser, TestSubQueryTransformerDistrib, TestSchemaNameResource, TestSerializedLuceneMatchVersion, TestManagedSynonymFilterFactory, BooleanFieldTest, CurrencyFieldTypeTest, PreAnalyzedFieldManagedSchemaCloudTest]
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=PreAnalyzedFieldManagedSchemaCloudTest -Dtests.seed=CCBFED55261C56D2 -Dtests.slow=true -Dtests.locale=da-DK -Dtests.timezone=Africa/Tunis -Dtests.asserts=true -Dtests.file.encoding=ISO-8859-1
[junit4] ERROR 0.00s J1 | PreAnalyzedFieldManagedSchemaCloudTest (suite) <<<
[junit4] > Throwable #1: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=28940, name=Thread-4967, state=RUNNABLE, group=TGRP-PreAnalyzedFieldManagedSchemaCloudTest]
[junit4] > Caused by: java.lang.NoClassDefFoundError: org/apache/solr/core/CoreContainer$CoreLoadFailure
[junit4] > at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2]:0)
[junit4] > at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1219)
[junit4] > at org.apache.solr.core.SolrCore.lambda$getConfListener$18(SolrCore.java:2939)
[junit4] > at org.apache.solr.cloud.ZkController.lambda$fireEventListeners$4(ZkController.java:2429)
[junit4] > at java.lang.Thread.run(Thread.java:748)Throwable #2: com.carrotsearch.randomizedtesting.UncaughtExceptionError: Captured an uncaught exception in thread: Thread[id=28941, name=Thread-4968, state=RUNNABLE, group=TGRP-PreAnalyzedFieldManagedSchemaCloudTest]
[junit4] > Caused by: java.lang.NoClassDefFoundError: org/apache/solr/core/CoreContainer$CoreLoadFailure
[junit4] > at __randomizedtesting.SeedInfo.seed([CCBFED55261C56D2]:0)
[junit4] > at org.apache.solr.core.CoreContainer.reload(CoreContainer.java:1219)
[junit4] > at org.apache.solr.core.SolrCore.lambda$getConfListener$18(SolrCore.java:2939)
[junit4] > at org.apache.solr.cloud.ZkController.lambda$fireEventListeners$4(ZkController.java:2429)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] Completed [652/727 (12!)] on J1 in 4.21s, 1 test, 2 errors <<< FAILURES!
[...truncated 43591 lines...]
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 17 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/17/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC
6 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore
Error Message:
Error from server at https://127.0.0.1:63438/solr: ADDREPLICA failed to create replica
Stack Trace:
org.apache.solr.client.solrj.impl.HttpSolrClient$RemoteSolrException: Error from server at https://127.0.0.1:63438/solr: ADDREPLICA failed to create replica
at __randomizedtesting.SeedInfo.seed([880D2BAA77C8C64C:64CB861E8C547BA8]:0)
at org.apache.solr.client.solrj.impl.HttpSolrClient.executeMethod(HttpSolrClient.java:626)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:252)
at org.apache.solr.client.solrj.impl.HttpSolrClient.request(HttpSolrClient.java:241)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.doRequest(LBHttpSolrClient.java:483)
at org.apache.solr.client.solrj.impl.LBHttpSolrClient.request(LBHttpSolrClient.java:413)
at org.apache.solr.client.solrj.impl.CloudSolrClient.sendRequest(CloudSolrClient.java:1121)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:862)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:195)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCreateShouldFailOnExistingCore(CollectionsAPIDistributedZkTest.java:287)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForImplicitRouter
Error Message:
Collection not found: withShardField
Stack Trace:
org.apache.solr.common.SolrException: Collection not found: withShardField
at __randomizedtesting.SeedInfo.seed([880D2BAA77C8C64C:DD5DC338DB3109BC]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.getCollectionNames(CloudSolrClient.java:1139)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:822)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForImplicitRouter(CustomCollectionTest.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.DistribCursorPagingTest.test
Error Message:
Stack Trace:
java.lang.NullPointerException
at __randomizedtesting.SeedInfo.seed([880D2BAA77C8C64C:591470D934ABB4]:0)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.getNodeName(JettySolrRunner.java:345)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createJettys(AbstractFullDistribZkTestBase.java:415)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.createServers(AbstractFullDistribZkTestBase.java:334)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:983)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DistribCursorPagingTest
Error Message:
21 threads leaked from SUITE scope at org.apache.solr.cloud.DistribCursorPagingTest: 1) Thread[id=14404, name=Connection evictor, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 2) Thread[id=14398, name=qtp1025002923-14398, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=14393, name=qtp1025002923-14393-acceptor-0@289ebb5b-ServerConnector@26594038{HTTP/1.1,[http/1.1]}{127.0.0.1:50847}, state=RUNNABLE, group=TGRP-DistribCursorPagingTest] at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422) at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250) at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:373) at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=14405, name=Connection evictor, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at java.lang.Thread.sleep(Native Method) at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=14410, name=TEST-DistribCursorPagingTest.test-seed#[880D2BAA77C8C64C]-EventThread, state=WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501) 6) Thread[id=14400, name=org.eclipse.jetty.server.session.HashSessionManager@17d297f6Timer, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) 7) Thread[id=14419, name=OverseerHdfsCoreFailoverThread-98271828165984265-127.0.0.1:50847_g_iwo%2Fwm-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=14417, name=OverseerStateUpdate-98271828165984265-127.0.0.1:50847_g_iwo%2Fwm-n_0000000001, state=TIMED_WAITING, group=Overseer state updater.] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:165) at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:139) at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:184) at java.lang.Thread.run(Thread.java:748) 9) Thread[id=14416, name=zkCallback-2403-thread-2, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) 10) Thread[id=14394, name=qtp1025002923-14394, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 11) Thread[id=14421, name=zkCallback-2403-thread-3, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) 12) Thread[id=14397, name=qtp1025002923-14397, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 13) Thread[id=14422, name=zkCallback-2403-thread-4, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) 14) Thread[id=14395, name=qtp1025002923-14395, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 15) Thread[id=14423, name=zkCallback-2403-thread-5, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) 16) Thread[id=14392, name=qtp1025002923-14392, state=RUNNABLE, group=TGRP-DistribCursorPagingTest] at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 17) Thread[id=14396, name=qtp1025002923-14396, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748) 18) Thread[id=14418, name=OverseerCollectionConfigSetProcessor-98271828165984265-127.0.0.1:50847_g_iwo%2Fwm-n_0000000001, state=TIMED_WAITING, group=Overseer collection creation process.] at java.lang.Thread.sleep(Native Method) at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70) at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354) at org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:387) at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:193) at java.lang.Thread.run(Thread.java:748) 19) Thread[id=14409, name=TEST-DistribCursorPagingTest.test-seed#[880D2BAA77C8C64C]-SendThread(127.0.0.1:50831), state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051) 20) Thread[id=14411, name=zkCallback-2403-thread-1, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) 21) Thread[id=14399, name=qtp1025002923-14399, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392) at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563) at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: 21 threads leaked from SUITE scope at org.apache.solr.cloud.DistribCursorPagingTest:
1) Thread[id=14404, name=Connection evictor, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
2) Thread[id=14398, name=qtp1025002923-14398, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=14393, name=qtp1025002923-14393-acceptor-0@289ebb5b-ServerConnector@26594038{HTTP/1.1,[http/1.1]}{127.0.0.1:50847}, state=RUNNABLE, group=TGRP-DistribCursorPagingTest]
at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:422)
at sun.nio.ch.ServerSocketChannelImpl.accept(ServerSocketChannelImpl.java:250)
at org.eclipse.jetty.server.ServerConnector.accept(ServerConnector.java:373)
at org.eclipse.jetty.server.AbstractConnector$Acceptor.run(AbstractConnector.java:601)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=14405, name=Connection evictor, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.http.impl.client.IdleConnectionEvictor$1.run(IdleConnectionEvictor.java:66)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=14410, name=TEST-DistribCursorPagingTest.test-seed#[880D2BAA77C8C64C]-EventThread, state=WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:501)
6) Thread[id=14400, name=org.eclipse.jetty.server.session.HashSessionManager@17d297f6Timer, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
7) Thread[id=14419, name=OverseerHdfsCoreFailoverThread-98271828165984265-127.0.0.1:50847_g_iwo%2Fwm-n_0000000001, state=TIMED_WAITING, group=Overseer Hdfs SolrCore Failover Thread.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.cloud.OverseerAutoReplicaFailoverThread.run(OverseerAutoReplicaFailoverThread.java:139)
at java.lang.Thread.run(Thread.java:748)
8) Thread[id=14417, name=OverseerStateUpdate-98271828165984265-127.0.0.1:50847_g_iwo%2Fwm-n_0000000001, state=TIMED_WAITING, group=Overseer state updater.]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:165)
at org.apache.solr.cloud.DistributedQueue.peek(DistributedQueue.java:139)
at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:184)
at java.lang.Thread.run(Thread.java:748)
9) Thread[id=14416, name=zkCallback-2403-thread-2, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
10) Thread[id=14394, name=qtp1025002923-14394, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
11) Thread[id=14421, name=zkCallback-2403-thread-3, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
12) Thread[id=14397, name=qtp1025002923-14397, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
13) Thread[id=14422, name=zkCallback-2403-thread-4, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
14) Thread[id=14395, name=qtp1025002923-14395, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
15) Thread[id=14423, name=zkCallback-2403-thread-5, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
16) Thread[id=14392, name=qtp1025002923-14392, state=RUNNABLE, group=TGRP-DistribCursorPagingTest]
at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
17) Thread[id=14396, name=qtp1025002923-14396, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
18) Thread[id=14418, name=OverseerCollectionConfigSetProcessor-98271828165984265-127.0.0.1:50847_g_iwo%2Fwm-n_0000000001, state=TIMED_WAITING, group=Overseer collection creation process.]
at java.lang.Thread.sleep(Native Method)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryDelay(ZkCmdExecutor.java:111)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.cloud.OverseerTaskProcessor.amILeader(OverseerTaskProcessor.java:387)
at org.apache.solr.cloud.OverseerTaskProcessor.run(OverseerTaskProcessor.java:193)
at java.lang.Thread.run(Thread.java:748)
19) Thread[id=14409, name=TEST-DistribCursorPagingTest.test-seed#[880D2BAA77C8C64C]-SendThread(127.0.0.1:50831), state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
20) Thread[id=14411, name=zkCallback-2403-thread-1, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
21) Thread[id=14399, name=qtp1025002923-14399, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([880D2BAA77C8C64C]:0)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.DistribCursorPagingTest
Error Message:
There are still zombie threads that couldn't be terminated: 1) Thread[id=14422, name=zkCallback-2403-thread-4, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) 2) Thread[id=14423, name=zkCallback-2403-thread-5, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) 3) Thread[id=14392, name=qtp1025002923-14392, state=RUNNABLE, group=TGRP-DistribCursorPagingTest] at sun.nio.ch.IOUtil.drain(Native Method) at sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:181) at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:122) at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243) at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148) at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100) at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671) at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589) at java.lang.Thread.run(Thread.java:748) 4) Thread[id=14400, name=org.eclipse.jetty.server.session.HashSessionManager@17d297f6Timer, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) 5) Thread[id=14416, name=zkCallback-2403-thread-2, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) 6) Thread[id=14409, name=TEST-DistribCursorPagingTest.test-seed#[880D2BAA77C8C64C]-SendThread(127.0.0.1:50831), state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at java.lang.Thread.sleep(Native Method) at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051) 7) Thread[id=14411, name=zkCallback-2403-thread-1, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) 8) Thread[id=14421, name=zkCallback-2403-thread-3, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest] at sun.misc.Unsafe.park(Native Method) at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
1) Thread[id=14422, name=zkCallback-2403-thread-4, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
2) Thread[id=14423, name=zkCallback-2403-thread-5, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
3) Thread[id=14392, name=qtp1025002923-14392, state=RUNNABLE, group=TGRP-DistribCursorPagingTest]
at sun.nio.ch.IOUtil.drain(Native Method)
at sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:181)
at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:122)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
at java.lang.Thread.run(Thread.java:748)
4) Thread[id=14400, name=org.eclipse.jetty.server.session.HashSessionManager@17d297f6Timer, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
5) Thread[id=14416, name=zkCallback-2403-thread-2, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
6) Thread[id=14409, name=TEST-DistribCursorPagingTest.test-seed#[880D2BAA77C8C64C]-SendThread(127.0.0.1:50831), state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at java.lang.Thread.sleep(Native Method)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
7) Thread[id=14411, name=zkCallback-2403-thread-1, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
8) Thread[id=14421, name=zkCallback-2403-thread-3, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
at sun.misc.Unsafe.park(Native Method)
at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
at __randomizedtesting.SeedInfo.seed([880D2BAA77C8C64C]:0)
FAILED: org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI
Error Message:
expected:<3> but was:<1>
Stack Trace:
java.lang.AssertionError: expected:<3> but was:<1>
at __randomizedtesting.SeedInfo.seed([880D2BAA77C8C64C:E2ECA5C14A527034]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.junit.Assert.assertEquals(Assert.java:456)
at org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI(CustomCollectionTest.java:97)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11528 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_880D2BAA77C8C64C-001/init-core-data-001
[junit4] 2> 931141 WARN (SUITE-CollectionsAPIDistributedZkTest-seed#[880D2BAA77C8C64C]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 931141 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[880D2BAA77C8C64C]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 931145 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[880D2BAA77C8C64C]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (true) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 931147 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[880D2BAA77C8C64C]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_880D2BAA77C8C64C-001/tempDir-001
[junit4] 2> 931148 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[880D2BAA77C8C64C]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 931148 INFO (Thread-1851) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 931148 INFO (Thread-1851) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 931151 ERROR (Thread-1851) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 931256 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[880D2BAA77C8C64C]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:63436
[junit4] 2> 931312 INFO (jetty-launcher-2815-thread-4) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 931313 INFO (jetty-launcher-2815-thread-3) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 931317 INFO (jetty-launcher-2815-thread-2) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 931319 INFO (jetty-launcher-2815-thread-1) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 931322 INFO (jetty-launcher-2815-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@5a9bf2bc{/solr,null,AVAILABLE}
[junit4] 2> 931340 INFO (jetty-launcher-2815-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6712c06e{/solr,null,AVAILABLE}
[junit4] 2> 931341 INFO (jetty-launcher-2815-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@63d5e8c6{SSL,[ssl, http/1.1]}{127.0.0.1:63438}
[junit4] 2> 931341 INFO (jetty-launcher-2815-thread-4) [ ] o.e.j.s.Server Started @935266ms
[junit4] 2> 931341 INFO (jetty-launcher-2815-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63438}
[junit4] 2> 931341 INFO (jetty-launcher-2815-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@35a916ba{SSL,[ssl, http/1.1]}{127.0.0.1:63439}
[junit4] 2> 931341 INFO (jetty-launcher-2815-thread-1) [ ] o.e.j.s.Server Started @935266ms
[junit4] 2> 931341 INFO (jetty-launcher-2815-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63439}
[junit4] 2> 931341 ERROR (jetty-launcher-2815-thread-4) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 931341 ERROR (jetty-launcher-2815-thread-1) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 931342 INFO (jetty-launcher-2815-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 931342 INFO (jetty-launcher-2815-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 931342 INFO (jetty-launcher-2815-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 931342 INFO (jetty-launcher-2815-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-08T10:04:21.313Z
[junit4] 2> 931342 INFO (jetty-launcher-2815-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 931342 INFO (jetty-launcher-2815-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 931342 INFO (jetty-launcher-2815-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 931342 INFO (jetty-launcher-2815-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-08T10:04:21.313Z
[junit4] 2> 931346 INFO (jetty-launcher-2815-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@6ddaea56{/solr,null,AVAILABLE}
[junit4] 2> 931348 INFO (jetty-launcher-2815-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@2dc033ee{/solr,null,AVAILABLE}
[junit4] 2> 931348 INFO (jetty-launcher-2815-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5ac12749{SSL,[ssl, http/1.1]}{127.0.0.1:63442}
[junit4] 2> 931348 INFO (jetty-launcher-2815-thread-2) [ ] o.e.j.s.Server Started @935273ms
[junit4] 2> 931348 INFO (jetty-launcher-2815-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63442}
[junit4] 2> 931348 ERROR (jetty-launcher-2815-thread-2) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 931348 INFO (jetty-launcher-2815-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7acf24dc{SSL,[ssl, http/1.1]}{127.0.0.1:63443}
[junit4] 2> 931348 INFO (jetty-launcher-2815-thread-3) [ ] o.e.j.s.Server Started @935274ms
[junit4] 2> 931348 INFO (jetty-launcher-2815-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=63443}
[junit4] 2> 931348 INFO (jetty-launcher-2815-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 931348 INFO (jetty-launcher-2815-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 931348 ERROR (jetty-launcher-2815-thread-3) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 931348 INFO (jetty-launcher-2815-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 931349 INFO (jetty-launcher-2815-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-08T10:04:21.320Z
[junit4] 2> 931349 INFO (jetty-launcher-2815-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 931349 INFO (jetty-launcher-2815-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 931349 INFO (jetty-launcher-2815-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 931349 INFO (jetty-launcher-2815-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-08T10:04:21.320Z
[junit4] 2> 931351 INFO (jetty-launcher-2815-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 931380 INFO (jetty-launcher-2815-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 931380 INFO (jetty-launcher-2815-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 931389 INFO (jetty-launcher-2815-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 931394 INFO (jetty-launcher-2815-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63436/solr
[junit4] 2> 931408 INFO (jetty-launcher-2815-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63436/solr
[junit4] 2> 931411 INFO (jetty-launcher-2815-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63436/solr
[junit4] 2> 931417 INFO (jetty-launcher-2815-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:63436/solr
[junit4] 2> 931465 INFO (jetty-launcher-2815-thread-4) [n:127.0.0.1:63438_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 931465 INFO (jetty-launcher-2815-thread-2) [n:127.0.0.1:63442_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 931472 INFO (jetty-launcher-2815-thread-2) [n:127.0.0.1:63442_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:63442_solr
[junit4] 2> 931473 INFO (jetty-launcher-2815-thread-4) [n:127.0.0.1:63438_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63438_solr
[junit4] 2> 931481 INFO (zkCallback-2835-thread-1-processing-n:127.0.0.1:63438_solr) [n:127.0.0.1:63438_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 931482 INFO (zkCallback-2830-thread-1-processing-n:127.0.0.1:63442_solr) [n:127.0.0.1:63442_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 931484 INFO (jetty-launcher-2815-thread-2) [n:127.0.0.1:63442_solr ] o.a.s.c.Overseer Overseer (id=98271773400825864-127.0.0.1:63442_solr-n_0000000000) starting
[junit4] 2> 931523 INFO (jetty-launcher-2815-thread-2) [n:127.0.0.1:63442_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63442_solr
[junit4] 2> 931529 INFO (zkCallback-2835-thread-1-processing-n:127.0.0.1:63438_solr) [n:127.0.0.1:63438_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 931529 INFO (zkCallback-2830-thread-1-processing-n:127.0.0.1:63442_solr) [n:127.0.0.1:63442_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 931533 INFO (jetty-launcher-2815-thread-1) [n:127.0.0.1:63439_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 931538 INFO (jetty-launcher-2815-thread-1) [n:127.0.0.1:63439_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 931543 INFO (jetty-launcher-2815-thread-1) [n:127.0.0.1:63439_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63439_solr
[junit4] 2> 931557 INFO (zkCallback-2840-thread-1-processing-n:127.0.0.1:63439_solr) [n:127.0.0.1:63439_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 931559 INFO (zkCallback-2835-thread-1-processing-n:127.0.0.1:63438_solr) [n:127.0.0.1:63438_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 931559 INFO (zkCallback-2830-thread-1-processing-n:127.0.0.1:63442_solr) [n:127.0.0.1:63442_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 931665 INFO (jetty-launcher-2815-thread-3) [n:127.0.0.1:63443_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 931668 INFO (jetty-launcher-2815-thread-3) [n:127.0.0.1:63443_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 931671 INFO (jetty-launcher-2815-thread-3) [n:127.0.0.1:63443_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:63443_solr
[junit4] 2> 931672 INFO (zkCallback-2840-thread-1-processing-n:127.0.0.1:63439_solr) [n:127.0.0.1:63439_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 931672 INFO (zkCallback-2830-thread-1-processing-n:127.0.0.1:63442_solr) [n:127.0.0.1:63442_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 931673 INFO (zkCallback-2835-thread-1-processing-n:127.0.0.1:63438_solr) [n:127.0.0.1:63438_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 931677 INFO (zkCallback-2829-thread-1-processing-n:127.0.0.1:63443_solr) [n:127.0.0.1:63443_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 931691 INFO (jetty-launcher-2815-thread-2) [n:127.0.0.1:63442_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931705 INFO (jetty-launcher-2815-thread-4) [n:127.0.0.1:63438_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931709 INFO (jetty-launcher-2815-thread-4) [n:127.0.0.1:63438_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931709 INFO (jetty-launcher-2815-thread-4) [n:127.0.0.1:63438_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931710 INFO (jetty-launcher-2815-thread-2) [n:127.0.0.1:63442_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931710 INFO (jetty-launcher-2815-thread-2) [n:127.0.0.1:63442_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931711 INFO (jetty-launcher-2815-thread-4) [n:127.0.0.1:63438_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_880D2BAA77C8C64C-001/tempDir-001/node4
[junit4] 2> 931711 INFO (jetty-launcher-2815-thread-2) [n:127.0.0.1:63442_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_880D2BAA77C8C64C-001/tempDir-001/node2
[junit4] 2> 931747 INFO (jetty-launcher-2815-thread-1) [n:127.0.0.1:63439_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931760 INFO (jetty-launcher-2815-thread-1) [n:127.0.0.1:63439_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931760 INFO (jetty-launcher-2815-thread-1) [n:127.0.0.1:63439_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931761 INFO (jetty-launcher-2815-thread-1) [n:127.0.0.1:63439_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_880D2BAA77C8C64C-001/tempDir-001/node1
[junit4] 2> 931792 INFO (jetty-launcher-2815-thread-3) [n:127.0.0.1:63443_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931801 INFO (jetty-launcher-2815-thread-3) [n:127.0.0.1:63443_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931801 INFO (jetty-launcher-2815-thread-3) [n:127.0.0.1:63443_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@44aedbea
[junit4] 2> 931803 INFO (jetty-launcher-2815-thread-3) [n:127.0.0.1:63443_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_880D2BAA77C8C64C-001/tempDir-001/node3
[junit4] 2> 931846 WARN (NIOServerCxn.Factory:0.0.0.0/0.0.0.0:0) [ ] o.a.z.s.NIOServerCnxn caught end of stream exception
[junit4] 2> EndOfStreamException: Unable to read additional data from client sessionid 0x15d21a84101000d, likely client has closed socket
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:239)
[junit4] 2> at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:203)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2> 931852 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[880D2BAA77C8C64C]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 931853 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[880D2BAA77C8C64C]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:63436/solr ready
[junit4] 2> 931904 INFO (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[880D2BAA77C8C64C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testTooManyReplicas
[junit4] 2> 931905 INFO (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[880D2BAA77C8C64C]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 931931 INFO (qtp987457303-11630) [n:127.0.0.1:63438_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=10&collection.configName=conf&name=collection&nrtReplicas=10&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 931935 INFO (OverseerThreadFactory-4334-thread-1-processing-n:127.0.0.1:63442_solr) [n:127.0.0.1:63442_solr ] o.a.s.c.CreateCollectionCmd Create collection collection
[junit4] 2> 931935 WARN (OverseerThreadFactory-4334-thread-1-processing-n:127.0.0.1:63442_solr) [n:127.0.0.1:63442_solr ] o.a.s.c.CreateCollectionCmd Specified number of replicas of 10 on collection collection is higher than the number of Solr instances currently live or live and part of your createNodeSet(4). It's unusual to run two replica of the same slice on the same Solr-instance.
[junit4] 2> 931935 ERROR (OverseerThreadFactory-4334-thread-1-processing-n:127.0.0.1:63442_solr) [n:127.0.0.1:63442_solr ] o.a.s.c.OverseerCollectionMessageHandler Collection: collection operation: create failed:org.apache.solr.common.SolrException: Cannot create collection collection. Value of maxShardsPerNode is 1, and the number of nodes currently live or live and part of your createNodeSet is 4. This allows a maximum of 4 to be created. Value of numShards is 2, value of nrtReplicas is 10, value of tlogReplicas is 0 and value of pullReplicas is 0. This requires 20 shards to be created (higher than the allowed number)
[junit4] 2> at org.apache.solr.cloud.CreateCollectionCmd.call(CreateCollectionCmd.java:157)
[junit4] 2> at org.apache.solr.cloud.OverseerCollectionMessageHandler.processMessage(OverseerCollectionMessageHandler.java:227)
[junit4] 2> at org.apache.solr.cloud.OverseerTaskProcessor$Runner.run(OverseerTaskProcessor.java:464)
[junit4] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[junit4] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] 2> at java.lang.Thread.run(Thread.java:748)
[junit4] 2>
[junit4] 2> 931956 INFO (qtp987457303-11630) [n:127.0.0.1:63438_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=10&collection.configName=conf&name=collection&nrtReplicas=10&action=CREATE&numShards=2&wt=javabin&version=2} status=400 QTime=25
[junit4] 2> 931957 INFO (TEST-CollectionsAPIDistributedZkTest.testTooManyReplicas-seed#[880D2BAA77C8C64C]) [ ] o.a.s.SolrTestCaseJ4 ###Ending testTooManyReplicas
[junit4] 2> 932013 INFO (TEST-CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes-seed#[880D2BAA77C8C64C]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCoresAreDistributedAcrossNodes
[junit4] 2> 932015 INFO (TEST-CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes-seed#[880D2BAA77C8C64C]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 932018 INFO (qtp987457303-11631) [n:127.0.0.1:63438_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=nodes_used_collection&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 932021 INFO (OverseerThreadFactory-4334-thread-2-processing-n:127.0.0.1:63442_solr) [n:127.0.0.1:63442_solr ] o.a.s.c.CreateCollectionCmd Create collection nodes_used_collection
[junit4] 2> 932022 INFO (OverseerCollectionConfigSetProcessor-98271773400825864-127.0.0.1:63442_solr-n_0000000000) [n:127.0.0.1:63442_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 932147 INFO (OverseerStateUpdate-98271773400825864-127.0.0.1:63442_solr-n_0000000000) [n:127.0.0.1:63442_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"nodes_used_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:63438/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 932150 INFO (OverseerStateUpdate-98271773400825864-127.0.0.1:63442_solr-n_0000000000) [n:127.0.0.1:63442_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"nodes_used_collection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:63442/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 932152 INFO (OverseerStateUpdate-98271773400825864-127.0.0.1:63442_solr-n_0000000000) [n:127.0.0.1:63442_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"nodes_used_collection_shard2_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:63439/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 932154 INFO (OverseerStateUpdate-98271773400825864-127.0.0.1:63442_solr-n_0000000000) [n:127.0.0.1:63442_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"nodes_used_collection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"nodes_used_collection_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"https://127.0.0.1:63443/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 932406 INFO (qtp987457303-11626) [n:127.0.0.1:63438_solr ] o.a.s.u.TestInjection Inject random core creation delay of 3s
[junit4] 2> 932407 INFO (qtp130132470-11661) [n:127.0.0.1:63443_solr ] o.a.s.u.TestInjection Inject random core creation delay of 3s
[junit4] 2> 932409 INFO (qtp1494431940-11640) [n:127.0.0.1:63439_solr ] o.a.s.u.TestInjection Inject random core creation delay of 3s
[junit4] 2> 932410 INFO (qtp1133857293-11649) [n:127.0.0.1:63442_solr ] o.a.s.u.TestInjection Inject random core creation delay of 3s
[junit4] 2> 935407 INFO (qtp987457303-11626) [n:127.0.0.1:63438_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node1&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard1_replica_n1&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 935408 INFO (qtp987457303-11626) [n:127.0.0.1:63438_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 935417 INFO (qtp130132470-11661) [n:127.0.0.1:63443_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard2_replica_n2&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 935417 INFO (qtp1494431940-11640) [n:127.0.0.1:63439_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=nodes_used_collection_shard2_replica_n1&action=CREATE&numShards=2&collection=nodes_used_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 935417 INFO (qtp1133857293-11649) [n:127.0.0.1:63442_solr ] o.a.s.h.a.CoreAdminOperation core create command
[...truncated too long message...]
util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 21) Thread[id=14399, name=qtp1025002923-14399, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] > at org.eclipse.jetty.util.BlockingArrayQueue.poll(BlockingArrayQueue.java:392)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.idleJobPoll(QueuedThreadPool.java:563)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.access$800(QueuedThreadPool.java:48)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:626)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([880D2BAA77C8C64C]:0)Throwable #2: com.carrotsearch.randomizedtesting.ThreadLeakError: There are still zombie threads that couldn't be terminated:
[junit4] > 1) Thread[id=14422, name=zkCallback-2403-thread-4, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 2) Thread[id=14423, name=zkCallback-2403-thread-5, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 3) Thread[id=14392, name=qtp1025002923-14392, state=RUNNABLE, group=TGRP-DistribCursorPagingTest]
[junit4] > at sun.nio.ch.IOUtil.drain(Native Method)
[junit4] > at sun.nio.ch.KQueueSelectorImpl.updateSelectedKeys(KQueueSelectorImpl.java:181)
[junit4] > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:122)
[junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
[junit4] > at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 4) Thread[id=14400, name=org.eclipse.jetty.server.session.HashSessionManager@17d297f6Timer, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 5) Thread[id=14416, name=zkCallback-2403-thread-2, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 6) Thread[id=14409, name=TEST-DistribCursorPagingTest.test-seed#[880D2BAA77C8C64C]-SendThread(127.0.0.1:50831), state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
[junit4] > 7) Thread[id=14411, name=zkCallback-2403-thread-1, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 8) Thread[id=14421, name=zkCallback-2403-thread-3, state=TIMED_WAITING, group=TGRP-DistribCursorPagingTest]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([880D2BAA77C8C64C]:0)
[junit4] Completed [499/727 (3!)] on J0 in 33.72s, 1 test, 3 errors <<< FAILURES!
[...truncated 44067 lines...]
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 16 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/16/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
3 tests failed.
FAILED: org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForHashRouter
Error Message:
Collection not found: routeFieldColl
Stack Trace:
org.apache.solr.common.SolrException: Collection not found: routeFieldColl
at __randomizedtesting.SeedInfo.seed([7E4B68214CDEBB87:D67DF6FCD3BF50DD]:0)
at org.apache.solr.client.solrj.impl.CloudSolrClient.getCollectionNames(CloudSolrClient.java:1139)
at org.apache.solr.client.solrj.impl.CloudSolrClient.requestWithRetryOnStaleState(CloudSolrClient.java:822)
at org.apache.solr.client.solrj.impl.CloudSolrClient.request(CloudSolrClient.java:793)
at org.apache.solr.client.solrj.SolrRequest.process(SolrRequest.java:178)
at org.apache.solr.client.solrj.request.UpdateRequest.commit(UpdateRequest.java:233)
at org.apache.solr.cloud.CustomCollectionTest.testRouteFieldForHashRouter(CustomCollectionTest.java:166)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI
Error Message:
Could not find collection : implicitcoll
Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : implicitcoll
at __randomizedtesting.SeedInfo.seed([7E4B68214CDEBB87:14AAE64A71440DFF]:0)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
at org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI(CustomCollectionTest.java:68)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Could not find collection:collection2
Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
at __randomizedtesting.SeedInfo.seed([7E4B68214CDEBB87:F61F57FBE222D67F]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:907)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:612)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11603 lines...]
[junit4] Suite: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/init-core-data-001
[junit4] 2> 1031587 WARN (SUITE-FullSolrCloudDistribCmdsTest-seed#[7E4B68214CDEBB87]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=42 numCloses=42
[junit4] 2> 1031587 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[7E4B68214CDEBB87]-worker) [ ] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 1031593 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[7E4B68214CDEBB87]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.SolrTestCaseJ4$SuppressSSL(bugUrl=https://issues.apache.org/jira/browse/SOLR-5776) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 1031593 INFO (SUITE-FullSolrCloudDistribCmdsTest-seed#[7E4B68214CDEBB87]-worker) [ ] o.a.s.BaseDistributedSearchTestCase Setting hostContext system property: /
[junit4] 2> 1031595 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 1031596 INFO (Thread-1982) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 1031596 INFO (Thread-1982) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 1031602 ERROR (Thread-1982) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1031700 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.ZkTestServer start zk server on port:60679
[junit4] 2> 1031750 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig-tlog.xml to /configs/conf1/solrconfig.xml
[junit4] 2> 1031773 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/schema15.xml to /configs/conf1/schema.xml
[junit4] 2> 1031777 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/solrconfig.snippet.randomindexconfig.xml to /configs/conf1/solrconfig.snippet.randomindexconfig.xml
[junit4] 2> 1031779 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/stopwords.txt to /configs/conf1/stopwords.txt
[junit4] 2> 1031781 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/protwords.txt to /configs/conf1/protwords.txt
[junit4] 2> 1031784 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/currency.xml to /configs/conf1/currency.xml
[junit4] 2> 1031786 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/enumsConfig.xml to /configs/conf1/enumsConfig.xml
[junit4] 2> 1031789 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/open-exchange-rates.json to /configs/conf1/open-exchange-rates.json
[junit4] 2> 1031792 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/mapping-ISOLatin1Accent.txt to /configs/conf1/mapping-ISOLatin1Accent.txt
[junit4] 2> 1031794 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/old_synonyms.txt to /configs/conf1/old_synonyms.txt
[junit4] 2> 1031798 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractZkTestCase put /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/core/src/test-files/solr/collection1/conf/synonyms.txt to /configs/conf1/synonyms.txt
[junit4] 2> 1031801 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractFullDistribZkTestBase Will use NRT replicas unless explicitly asked otherwise
[junit4] 2> 1032936 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1032939 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@28265f21{/,null,AVAILABLE}
[junit4] 2> 1032940 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7c1fe880{HTTP/1.1,[http/1.1]}{127.0.0.1:60683}
[junit4] 2> 1032940 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.Server Started @1037233ms
[junit4] 2> 1032941 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/tempDir-001/control/data, replicaType=NRT, hostContext=/, hostPort=60683, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/control-001/cores}
[junit4] 2> 1032946 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1032955 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 1032956 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1032956 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1032956 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-08T04:34:11.979Z
[junit4] 2> 1032964 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1032964 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/control-001/solr.xml
[junit4] 2> 1032990 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1032997 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60679/solr
[junit4] 2> 1033185 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60683_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1033186 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60683_ ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60683_
[junit4] 2> 1033188 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60683_ ] o.a.s.c.Overseer Overseer (id=98270475100094468-127.0.0.1:60683_-n_0000000000) starting
[junit4] 2> 1033210 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60683_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60683_
[junit4] 2> 1033212 INFO (zkCallback-1696-thread-1-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1033380 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60683_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1033388 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60683_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1033389 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60683_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1033391 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60683_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/control-001/cores
[junit4] 2> 1033438 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1033439 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60679/solr ready
[junit4] 2> 1033444 INFO (qtp369761446-10121) [n:127.0.0.1:60683_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:60683_&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1033447 INFO (OverseerThreadFactory-4693-thread-1-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.CreateCollectionCmd Create collection control_collection
[junit4] 2> 1033562 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1033563 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1033677 INFO (zkCallback-1696-thread-1-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1034619 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1034698 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema [control_collection_shard1_replica_n1] Schema name=test
[junit4] 2> 1034792 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1034813 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'control_collection_shard1_replica_n1' using configuration from collection control_collection, trusted=true
[junit4] 2> 1034813 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.control_collection.shard1.replica_n1' (registry 'solr.core.control_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1034814 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1034814 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [[control_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/control-001/cores/control_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/control-001/cores/control_collection_shard1_replica_n1/data/]
[junit4] 2> 1034815 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=95.51171875, floorSegmentMB=1.81640625, forceMergeDeletesPctAllowed=19.959987822534316, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1034821 WARN (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1034893 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1034893 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1034896 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1034896 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1034897 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=15.8759765625, floorSegmentMB=1.76953125, forceMergeDeletesPctAllowed=25.346819792300195, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7498860359578403
[junit4] 2> 1034898 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2b04162c[control_collection_shard1_replica_n1] main]
[junit4] 2> 1034900 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1034901 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1034901 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1034902 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572327605062860800
[junit4] 2> 1034903 INFO (searcherExecutor-4696-thread-1-processing-n:127.0.0.1:60683_ x:control_collection_shard1_replica_n1 s:shard1 c:control_collection) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SolrCore [control_collection_shard1_replica_n1] Registered new searcher Searcher@2b04162c[control_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1034910 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1034910 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1034910 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60683/control_collection_shard1_replica_n1/
[junit4] 2> 1034911 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1034911 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.SyncStrategy http://127.0.0.1:60683/control_collection_shard1_replica_n1/ has no replicas
[junit4] 2> 1034911 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1034916 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60683/control_collection_shard1_replica_n1/ shard1
[junit4] 2> 1035026 INFO (zkCallback-1696-thread-1-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1035085 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1035088 INFO (qtp369761446-10122) [n:127.0.0.1:60683_ c:control_collection s:shard1 x:control_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&newCollection=true&name=control_collection_shard1_replica_n1&action=CREATE&numShards=1&collection=control_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1526
[junit4] 2> 1035092 INFO (qtp369761446-10121) [n:127.0.0.1:60683_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1035191 INFO (zkCallback-1696-thread-1-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/control_collection/state.json] for collection [control_collection] has occurred - updating... (live nodes size: [1])
[junit4] 2> 1035457 INFO (OverseerCollectionConfigSetProcessor-98270475100094468-127.0.0.1:60683_-n_0000000000) [n:127.0.0.1:60683_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1036101 INFO (qtp369761446-10121) [n:127.0.0.1:60683_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=control_collection&nrtReplicas=1&action=CREATE&numShards=1&createNodeSet=127.0.0.1:60683_&wt=javabin&version=2} status=0 QTime=2657
[junit4] 2> 1036109 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1036110 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60679/solr ready
[junit4] 2> 1036110 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.ChaosMonkey monkey: init - expire sessions:false cause connection loss:false
[junit4] 2> 1036111 INFO (qtp369761446-10126) [n:127.0.0.1:60683_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1036114 INFO (OverseerThreadFactory-4693-thread-2-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 1036115 WARN (OverseerThreadFactory-4693-thread-2-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.CreateCollectionCmd It is unusual to create a collection (collection1) without cores.
[junit4] 2> 1036333 INFO (qtp369761446-10126) [n:127.0.0.1:60683_ ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 1036333 INFO (qtp369761446-10126) [n:127.0.0.1:60683_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=1&collection.configName=conf1&name=collection1&nrtReplicas=1&action=CREATE&numShards=3&createNodeSet=&stateFormat=1&wt=javabin&version=2} status=0 QTime=221
[junit4] 2> 1036835 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 1 in directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-1-001 of type NRT
[junit4] 2> 1036835 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1036837 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4774b505{/,null,AVAILABLE}
[junit4] 2> 1036837 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@11e5e790{HTTP/1.1,[http/1.1]}{127.0.0.1:60698}
[junit4] 2> 1036838 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.Server Started @1041130ms
[junit4] 2> 1036838 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/tempDir-001/jetty1, solrconfig=solrconfig.xml, hostContext=/, hostPort=60698, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-1-001/cores}
[junit4] 2> 1036838 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1036839 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 1036839 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1036839 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1036839 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-08T04:34:15.862Z
[junit4] 2> 1036843 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1036843 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-1-001/solr.xml
[junit4] 2> 1036855 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1036859 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60679/solr
[junit4] 2> 1036878 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60698_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 1036883 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60698_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1036887 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60698_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60698_
[junit4] 2> 1036892 INFO (zkCallback-1696-thread-1-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1036892 INFO (zkCallback-1703-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1036895 INFO (zkCallback-1708-thread-1-processing-n:127.0.0.1:60698_) [n:127.0.0.1:60698_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 1037008 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60698_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1037031 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60698_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1037031 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60698_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1037033 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60698_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-1-001/cores
[junit4] 2> 1037079 INFO (qtp369761446-10119) [n:127.0.0.1:60683_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:60698_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1037084 INFO (OverseerCollectionConfigSetProcessor-98270475100094468-127.0.0.1:60683_-n_0000000000) [n:127.0.0.1:60683_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000002 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1037087 INFO (OverseerThreadFactory-4693-thread-3-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:60698_ for creating new replica
[junit4] 2> 1037091 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n0&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1037091 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1038137 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1038148 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.s.IndexSchema [collection1_shard2_replica_n0] Schema name=test
[junit4] 2> 1038240 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1038260 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n0' using configuration from collection collection1, trusted=true
[junit4] 2> 1038260 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard2.replica_n0' (registry 'solr.core.collection1.shard2.replica_n0') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1038260 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1038260 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SolrCore [[collection1_shard2_replica_n0] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-1-001/cores/collection1_shard2_replica_n0], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-1-001/cores/collection1_shard2_replica_n0/data/]
[junit4] 2> 1038260 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=95.51171875, floorSegmentMB=1.81640625, forceMergeDeletesPctAllowed=19.959987822534316, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1038266 WARN (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1038343 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1038343 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1038345 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1038345 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1038346 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=15.8759765625, floorSegmentMB=1.76953125, forceMergeDeletesPctAllowed=25.346819792300195, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7498860359578403
[junit4] 2> 1038346 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.s.SolrIndexSearcher Opening [Searcher@fd0744f[collection1_shard2_replica_n0] main]
[junit4] 2> 1038348 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1038348 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1038349 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1038349 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572327608677302272
[junit4] 2> 1038350 INFO (searcherExecutor-4707-thread-1-processing-n:127.0.0.1:60698_ x:collection1_shard2_replica_n0 s:shard2 c:collection1) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SolrCore [collection1_shard2_replica_n0] Registered new searcher Searcher@fd0744f[collection1_shard2_replica_n0] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1038358 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1038358 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1038358 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60698/collection1_shard2_replica_n0/
[junit4] 2> 1038358 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1038358 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.SyncStrategy http://127.0.0.1:60698/collection1_shard2_replica_n0/ has no replicas
[junit4] 2> 1038358 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1038365 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60698/collection1_shard2_replica_n0/ shard2
[junit4] 2> 1038477 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1038484 INFO (qtp2070208501-10162) [n:127.0.0.1:60698_ c:collection1 s:shard2 x:collection1_shard2_replica_n0] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard2_replica_n0&action=CREATE&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1393
[junit4] 2> 1038488 INFO (qtp369761446-10119) [n:127.0.0.1:60683_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:60698_&action=ADDREPLICA&collection=collection1&shard=shard2&type=NRT&wt=javabin&version=2} status=0 QTime=1410
[junit4] 2> 1039075 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 2 in directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-2-001 of type NRT
[junit4] 2> 1039075 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1039076 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@174dc2b4{/,null,AVAILABLE}
[junit4] 2> 1039077 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@f08875a{HTTP/1.1,[http/1.1]}{127.0.0.1:60709}
[junit4] 2> 1039077 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.Server Started @1043369ms
[junit4] 2> 1039077 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/tempDir-001/jetty2, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=60709, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-2-001/cores}
[junit4] 2> 1039078 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1039078 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 1039078 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1039078 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1039078 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-08T04:34:18.101Z
[junit4] 2> 1039082 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1039082 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-2-001/solr.xml
[junit4] 2> 1039099 INFO (OverseerCollectionConfigSetProcessor-98270475100094468-127.0.0.1:60683_-n_0000000000) [n:127.0.0.1:60683_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000004 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1039109 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1039115 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60679/solr
[junit4] 2> 1039138 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60709_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 1039150 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60709_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1039154 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60709_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60709_
[junit4] 2> 1039157 INFO (zkCallback-1708-thread-1-processing-n:127.0.0.1:60698_) [n:127.0.0.1:60698_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1039157 INFO (zkCallback-1703-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1039157 INFO (zkCallback-1696-thread-1-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1039158 INFO (zkCallback-1714-thread-1-processing-n:127.0.0.1:60709_) [n:127.0.0.1:60709_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 1039373 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60709_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1039377 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60709_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1039377 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60709_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1039379 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60709_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-2-001/cores
[junit4] 2> 1039423 INFO (qtp1888072175-10191) [n:127.0.0.1:60709_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:60709_&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1039429 INFO (OverseerThreadFactory-4693-thread-4-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:60709_ for creating new replica
[junit4] 2> 1039430 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n0&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1039431 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1040459 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1040472 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.s.IndexSchema [collection1_shard3_replica_n0] Schema name=test
[junit4] 2> 1040699 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1040730 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard3_replica_n0' using configuration from collection collection1, trusted=true
[junit4] 2> 1040731 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard3.replica_n0' (registry 'solr.core.collection1.shard3.replica_n0') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1040731 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1040731 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SolrCore [[collection1_shard3_replica_n0] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-2-001/cores/collection1_shard3_replica_n0], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-2-001/cores/collection1_shard3_replica_n0/data/]
[junit4] 2> 1040737 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=95.51171875, floorSegmentMB=1.81640625, forceMergeDeletesPctAllowed=19.959987822534316, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1040741 WARN (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1040871 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1040871 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1040874 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1040874 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1040875 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=15.8759765625, floorSegmentMB=1.76953125, forceMergeDeletesPctAllowed=25.346819792300195, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7498860359578403
[junit4] 2> 1040876 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.s.SolrIndexSearcher Opening [Searcher@68ab0601[collection1_shard3_replica_n0] main]
[junit4] 2> 1040878 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1040879 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1040880 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1040880 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572327611331248128
[junit4] 2> 1040881 INFO (searcherExecutor-4718-thread-1-processing-n:127.0.0.1:60709_ x:collection1_shard3_replica_n0 s:shard3 c:collection1) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SolrCore [collection1_shard3_replica_n0] Registered new searcher Searcher@68ab0601[collection1_shard3_replica_n0] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1040888 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1040888 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1040888 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60709/collection1_shard3_replica_n0/
[junit4] 2> 1040888 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1040889 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.SyncStrategy http://127.0.0.1:60709/collection1_shard3_replica_n0/ has no replicas
[junit4] 2> 1040889 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1040894 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60709/collection1_shard3_replica_n0/ shard3
[junit4] 2> 1041049 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1041053 INFO (qtp1888072175-10192) [n:127.0.0.1:60709_ c:collection1 s:shard3 x:collection1_shard3_replica_n0] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard3_replica_n0&action=CREATE&collection=collection1&shard=shard3&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1622
[junit4] 2> 1041055 INFO (qtp1888072175-10191) [n:127.0.0.1:60709_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:60709_&action=ADDREPLICA&collection=collection1&shard=shard3&type=NRT&wt=javabin&version=2} status=0 QTime=1631
[junit4] 2> 1041430 INFO (OverseerCollectionConfigSetProcessor-98270475100094468-127.0.0.1:60683_-n_0000000000) [n:127.0.0.1:60683_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000006 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1041457 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 3 in directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-3-001 of type NRT
[junit4] 2> 1041457 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1041459 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@3eab8999{/,null,AVAILABLE}
[junit4] 2> 1041459 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@76d43ee8{HTTP/1.1,[http/1.1]}{127.0.0.1:60727}
[junit4] 2> 1041459 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.Server Started @1045752ms
[junit4] 2> 1041459 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/tempDir-001/jetty3, replicaType=NRT, solrconfig=solrconfig.xml, hostContext=/, hostPort=60727, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-3-001/cores}
[junit4] 2> 1041460 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1041462 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 1041462 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1041462 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1041462 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-08T04:34:20.485Z
[junit4] 2> 1041466 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1041466 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-3-001/solr.xml
[junit4] 2> 1041473 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1041477 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60679/solr
[junit4] 2> 1041503 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60727_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (3)
[junit4] 2> 1041508 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60727_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1041511 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60727_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60727_
[junit4] 2> 1041514 INFO (zkCallback-1703-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1041514 INFO (zkCallback-1714-thread-1-processing-n:127.0.0.1:60709_) [n:127.0.0.1:60709_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1041514 INFO (zkCallback-1696-thread-1-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1041514 INFO (zkCallback-1708-thread-1-processing-n:127.0.0.1:60698_) [n:127.0.0.1:60698_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1041515 INFO (zkCallback-1720-thread-1-processing-n:127.0.0.1:60727_) [n:127.0.0.1:60727_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 1041625 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60727_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1041628 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60727_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1041628 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60727_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1041630 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60727_ ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-3-001/cores
[junit4] 2> 1041671 INFO (qtp1888072175-10194) [n:127.0.0.1:60709_ ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :addreplica with params node=127.0.0.1:60727_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 1041675 INFO (OverseerThreadFactory-4693-thread-5-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.AddReplicaCmd Node Identified 127.0.0.1:60727_ for creating new replica
[junit4] 2> 1041679 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n0&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 1041680 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 4 transient cores
[junit4] 2> 1042707 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 1042718 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.IndexSchema [collection1_shard1_replica_n0] Schema name=test
[junit4] 2> 1042827 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.IndexSchema Loaded schema test/1.6 with uniqueid field id
[junit4] 2> 1042851 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n0' using configuration from collection collection1, trusted=true
[junit4] 2> 1042851 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.collection1.shard1.replica_n0' (registry 'solr.core.collection1.shard1.replica_n0') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1042851 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 1042851 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrCore [[collection1_shard1_replica_n0] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-3-001/cores/collection1_shard1_replica_n0], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/../../../../../../../../../Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-3-001/cores/collection1_shard1_replica_n0/data/]
[junit4] 2> 1042854 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=24, maxMergeAtOnceExplicit=44, maxMergedSegmentMB=95.51171875, floorSegmentMB=1.81640625, forceMergeDeletesPctAllowed=19.959987822534316, segmentsPerTier=39.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.0
[junit4] 2> 1042858 WARN (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.RequestHandlers INVALID paramSet a in requestHandler {type = requestHandler,name = /dump,class = DumpRequestHandler,attributes = {initParams=a, name=/dump, class=DumpRequestHandler},args = {defaults={a=A,b=B}}}
[junit4] 2> 1042945 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 1042945 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir= defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 1042948 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 1042948 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 1042949 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.RandomMergePolicy RandomMergePolicy wrapping class org.apache.lucene.index.TieredMergePolicy: [TieredMergePolicy: maxMergeAtOnce=35, maxMergeAtOnceExplicit=34, maxMergedSegmentMB=15.8759765625, floorSegmentMB=1.76953125, forceMergeDeletesPctAllowed=25.346819792300195, segmentsPerTier=18.0, maxCFSSegmentSizeMB=8.796093022207999E12, noCFSRatio=0.7498860359578403
[junit4] 2> 1042949 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.SolrIndexSearcher Opening [Searcher@17515497[collection1_shard1_replica_n0] main]
[junit4] 2> 1042951 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf1
[junit4] 2> 1042952 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf1
[junit4] 2> 1042952 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 1042953 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572327613504946176
[junit4] 2> 1042954 INFO (searcherExecutor-4729-thread-1-processing-n:127.0.0.1:60727_ x:collection1_shard1_replica_n0 s:shard1 c:collection1) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SolrCore [collection1_shard1_replica_n0] Registered new searcher Searcher@17515497[collection1_shard1_replica_n0] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 1042960 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 1042960 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 1042960 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60727/collection1_shard1_replica_n0/
[junit4] 2> 1042960 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SyncStrategy Sync Success - now sync replicas to me
[junit4] 2> 1042961 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.SyncStrategy http://127.0.0.1:60727/collection1_shard1_replica_n0/ has no replicas
[junit4] 2> 1042961 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 1042965 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60727/collection1_shard1_replica_n0/ shard1
[junit4] 2> 1043118 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 1043122 INFO (qtp1589705932-10220) [n:127.0.0.1:60727_ c:collection1 s:shard1 x:collection1_shard1_replica_n0] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&collection.configName=conf1&name=collection1_shard1_replica_n0&action=CREATE&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1442
[junit4] 2> 1043124 INFO (qtp1888072175-10194) [n:127.0.0.1:60709_ ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={node=127.0.0.1:60727_&action=ADDREPLICA&collection=collection1&shard=shard1&type=NRT&wt=javabin&version=2} status=0 QTime=1453
[junit4] 2> 1043610 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.AbstractFullDistribZkTestBase create jetty 4 in directory /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-4-001 of type NRT
[junit4] 2> 1043611 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 1043617 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@7d1d305e{/,null,AVAILABLE}
[junit4] 2> 1043617 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@2b096cd2{HTTP/1.1,[http/1.1]}{127.0.0.1:60734}
[junit4] 2> 1043617 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.e.j.s.Server Started @1047910ms
[junit4] 2> 1043617 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {solr.data.dir=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/tempDir-001/jetty4, solrconfig=solrconfig.xml, hostContext=/, hostPort=60734, coreRootDirectory=/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-4-001/cores}
[junit4] 2> 1043617 ERROR (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 1043618 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 1043618 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 1043618 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 1043618 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-08T04:34:22.641Z
[junit4] 2> 1043622 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.s.SolrDispatchFilter Loading solr.xml from SolrHome (not found in ZooKeeper)
[junit4] 2> 1043622 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.SolrXmlConfig Loading container configuration from /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.FullSolrCloudDistribCmdsTest_7E4B68214CDEBB87-001/shard-4-001/solr.xml
[junit4] 2> 1043629 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.SolrXmlConfig MBean server found: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01, but no JMX reporters were configured - adding default JMX reporter.
[junit4] 2> 1043633 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60679/solr
[junit4] 2> 1043648 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60734_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 1043654 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60734_ ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 1043659 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60734_ ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60734_
[junit4] 2> 1043662 INFO (zkCallback-1708-thread-1-processing-n:127.0.0.1:60698_) [n:127.0.0.1:60698_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1043663 INFO (zkCallback-1720-thread-1-processing-n:127.0.0.1:60727_) [n:127.0.0.1:60727_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1043663 INFO (zkCallback-1696-thread-2-processing-n:127.0.0.1:60683_) [n:127.0.0.1:60683_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1043663 INFO (zkCallback-1703-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1043663 INFO (zkCallback-1714-thread-1-processing-n:127.0.0.1:60709_) [n:127.0.0.1:60709_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1043665 INFO (zkCallback-1726-thread-1-processing-n:127.0.0.1:60734_) [n:127.0.0.1:60734_ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (5)
[junit4] 2> 1043679 INFO (OverseerCollectionConfigSetProcessor-98270475100094468-127.0.0.1:60683_-n_0000000000) [n:127.0.0.1:60683_ ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000008 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 1043785 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60734_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@1cf7af01
[junit4] 2> 1043790 INFO (TEST-FullSolrCloudDistribCmdsTest.test-seed#[7E4B68214CDEBB87]) [n:127.0.0.1:60734_ ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbea
[...truncated too long message...]
] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@54e5c547{/solr,null,UNAVAILABLE}
[junit4] 2> 2139973 WARN (zkCallback-2597-thread-1-processing-n:127.0.0.1:49819_solr) [n:127.0.0.1:49819_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 2139974 INFO (jetty-closer-2578-thread-1) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@448c0483{/solr,null,UNAVAILABLE}
[junit4] 2> 2139976 ERROR (SUITE-CustomCollectionTest-seed#[7E4B68214CDEBB87]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 2139977 INFO (SUITE-CustomCollectionTest-seed#[7E4B68214CDEBB87]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49815 49815
[junit4] 2> 2140020 INFO (Thread-3399) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49815 49815
[junit4] 2> 2140204 WARN (Thread-3399) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 9 /solr/aliases.json
[junit4] 2> 7 /solr/configs/conf
[junit4] 2> 5 /solr/collections/implicitcoll/state.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/collections/routeFieldColl/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 25 /solr/collections/testCreateShardRepFactor/state.json
[junit4] 2> 22 /solr/collections/withShardField/state.json
[junit4] 2> 14 /solr/collections/implicitcoll/state.json
[junit4] 2> 12 /solr/collections/routeFieldColl/state.json
[junit4] 2> 9 /solr/clusterstate.json
[junit4] 2> 3 /solr/collections/withShardField/leader_elect/a/election/98270542577729548-core_node3-n_0000000000
[junit4] 2> 3 /solr/collections/withShardField/leader_elect/d/election/98270542577729547-core_node20-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/98270542577729545-127.0.0.1:49818_solr-n_0000000000
[junit4] 2> 2 /solr/collections/withShardField/leader_elect/c/election/98270542577729546-core_node14-n_0000000000
[junit4] 2> 2 /solr/collections/withShardField/leader_elect/b/election/98270542577729546-core_node10-n_0000000000
[junit4] 2> 2 /solr/collections/withShardField/leader_elect/b/election/98270542577729546-core_node6-n_0000000002
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 31 /solr/collections
[junit4] 2> 9 /solr/live_nodes
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.CustomCollectionTest_7E4B68214CDEBB87-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {shard_s=Lucene50(blocksize=128), _version_=Lucene50(blocksize=128), id=TestBloomFilteredLucenePostings(BloomFilteringPostingsFormat(Lucene50(blocksize=128)))}, docValues:{}, maxPointsInLeafNode=1260, maxMBSortInHeap=7.575112959865013, sim=RandomSimilarity(queryNorm=true): {}, locale=ar-JO, timezone=America/Mexico_City
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_131 (64-bit)/cpus=3,threads=1,free=111466048,total=525860864
[junit4] 2> NOTE: All tests run in this JVM: [TestImplicitCoreProperties, HdfsChaosMonkeyNothingIsSafeTest, DistributedFacetPivotLargeTest, TestPHPSerializedResponseWriter, RequiredFieldsTest, TestGraphMLResponseWriter, TestReloadDeadlock, TestNumericTerms64, RAMDirectoryFactoryTest, ShardRoutingTest, TestLeaderElectionWithEmptyReplica, CursorMarkTest, LeaderInitiatedRecoveryOnShardRestartTest, TestSweetSpotSimilarityFactory, NodeMutatorTest, TestSolrFieldCacheBean, TestCSVResponseWriter, TestBinaryField, TestRawTransformer, TestCloudRecovery, ChaosMonkeySafeLeaderWithPullReplicasTest, TestLegacyFieldReuse, NumericFieldsTest, NoCacheHeaderTest, HdfsRestartWhileUpdatingTest, PeerSyncTest, SparseHLLTest, TestXmlQParser, TestSolrConfigHandlerConcurrent, TestFieldCacheSort, TestRandomDVFaceting, ZkCLITest, HdfsRecoverLeaseTest, TestSolrCoreSnapshots, TestManagedSchema, TestCollapseQParserPlugin, UninvertDocValuesMergePolicyTest, DocExpirationUpdateProcessorFactoryTest, DistanceFunctionTest, OverseerStatusTest, TestCodecSupport, TestRandomCollapseQParserPlugin, TestRandomFlRTGCloud, TestLegacyFieldCache, ForceLeaderTest, SliceStateTest, TestFuzzyAnalyzedSuggestions, AtomicUpdateProcessorFactoryTest, DistributedVersionInfoTest, UnloadDistributedZkTest, ClusterStateUpdateTest, TestFieldCache, TestLeaderInitiatedRecoveryThread, LeaderFailureAfterFreshStartTest, TestBinaryResponseWriter, JSONWriterTest, TestFieldCollectionResource, StressHdfsTest, SyncSliceTest, HighlighterConfigTest, TestStressUserVersions, SuggesterTest, TestJsonRequest, TestXIncludeConfig, MoveReplicaTest, DirectUpdateHandlerOptimizeTest, TestIndexingPerformance, TimeZoneUtilsTest, BinaryUpdateRequestHandlerTest, BufferStoreTest, TestSSLRandomization, OverseerTest, SolrGangliaReporterTest, HdfsLockFactoryTest, TestSchemaManager, CdcrVersionReplicationTest, TestShortCircuitedRequests, TestDFRSimilarityFactory, VersionInfoTest, ResponseHeaderTest, TestSolrXml, AsyncCallRequestStatusResponseTest, StatsReloadRaceTest, WordBreakSolrSpellCheckerTest, V2ApiIntegrationTest, AnalysisAfterCoreReloadTest, TestMaxTokenLenTokenizer, ReplicationFactorTest, TestOnReconnectListenerSupport, TestTolerantSearch, RulesTest, DefaultValueUpdateProcessorTest, HdfsDirectoryFactoryTest, TestInitQParser, AliasIntegrationTest, ScriptEngineTest, ManagedSchemaRoundRobinCloudTest, TestIBSimilarityFactory, TestStressRecovery, TestStressVersions, TestBulkSchemaConcurrent, TestQuerySenderListener, TestMultiWordSynonyms, SharedFSAutoReplicaFailoverTest, XsltUpdateRequestHandlerTest, TestRuleBasedAuthorizationPlugin, TestFaceting, TestLazyCores, SpatialFilterTest, TestDefaultStatsCache, TestConfigSetImmutable, PeerSyncWithIndexFingerprintCachingTest, TestStressReorder, AnalyticsMergeStrategyTest, TestSort, ParsingFieldUpdateProcessorsTest, CoreAdminHandlerTest, SpellCheckCollatorWithCollapseTest, TestLegacyTerms, TestPayloadScoreQParserPlugin, FieldAnalysisRequestHandlerTest, CleanupOldIndexTest, TestSolr4Spatial2, TestAtomicUpdateErrorCases, TestCloudPivotFacet, ReplicaListTransformerTest, TestDistribDocBasedVersion, SubstringBytesRefFilterTest, SolrCoreMetricManagerTest, ZkStateReaderTest, TestFieldTypeCollectionResource, TestFieldCacheVsDocValues, TestDFISimilarityFactory, SimpleFacetsTest, SolrTestCaseJ4Test, TestCloudInspectUtil, UUIDUpdateProcessorFallbackTest, TestSolrCoreProperties, CursorPagingTest, TestChildDocTransformer, TestFoldingMultitermQuery, TestNumericTokenStream, SolrCloudReportersTest, TestManagedResource, TestCursorMarkWithoutUniqueKey, SimplePostToolTest, TestEmbeddedSolrServerSchemaAPI, SolrJmxReporterTest, TestPhraseSuggestions, TestHighlightDedupGrouping, BasicDistributedZkTest, TestMaxScoreQueryParser, DistributedExpandComponentTest, LeaderElectionContextKeyTest, TestTestInjection, TestLRUStatsCache, RegexBoostProcessorTest, FastVectorHighlighterTest, TestCoreContainer, TestUseDocValuesAsStored, TestReRankQParserPlugin, TestFieldSortValues, TestPullReplica, SaslZkACLProviderTest, IndexBasedSpellCheckerTest, TestUtils, CollectionsAPISolrJTest, CoreAdminCreateDiscoverTest, ClassificationUpdateProcessorFactoryTest, TestSolrDeletionPolicy2, SearchHandlerTest, SpatialHeatmapFacetsTest, TestRestoreCore, PeerSyncReplicationTest, TestSortByMinMaxFunction, TestExtendedDismaxParser, TestReversedWildcardFilterFactory, DistributedTermsComponentTest, TestGroupingSearch, QueryElevationComponentTest, BadIndexSchemaTest, TestFiltering, BasicFunctionalityTest, TestIndexSearcher, ShowFileRequestHandlerTest, DistributedQueryElevationComponentTest, SolrIndexSplitterTest, SignatureUpdateProcessorFactoryTest, SpellCheckCollatorTest, SolrRequestParserTest, DocValuesTest, SuggesterWFSTTest, TestCSVLoader, PolyFieldTest, SchemaVersionSpecificBehaviorTest, SolrCoreCheckLockOnStartupTest, TestPseudoReturnFields, TestUpdate, QueryEqualityTest, SortByFunctionTest, SolrInfoBeanTest, DebugComponentTest, TestSurroundQueryParser, DisMaxRequestHandlerTest, TestWriterPerf, PrimitiveFieldTypeTest, TestOmitPositions, XmlUpdateRequestHandlerTest, RequestHandlersTest, DocumentBuilderTest, PathHierarchyTokenizerFactoryTest, MoreLikeThisHandlerTest, IndexSchemaTest, TestJmxIntegration, ReturnFieldsTest, UpdateRequestProcessorFactoryTest, QueryParsingTest, UniqFieldsUpdateProcessorFactoryTest, TestPartialUpdateDeduplication, SearchHandlerTest, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, ResponseLogComponentTest, TestMergePolicyConfig, MinimalSchemaTest, OutputWriterTest, TestPostingsSolrHighlighter, TestLuceneMatchVersion, SynonymTokenizerTest, TestPerFieldSimilarity, TestLMDirichletSimilarityFactory, ResourceLoaderTest, OpenExchangeRatesOrgProviderTest, PluginInfoTest, DateMathParserTest, PreAnalyzedFieldTest, TestSystemIdResolver, PrimUtilsTest, DateFieldTest, SpellingQueryConverterTest, ClusterStateTest, TestLRUCache, TestDocumentBuilder, ZkNodePropsTest, SystemInfoHandlerTest, UUIDFieldTest, FileUtilsTest, CircularListTest, DistributedMLTComponentTest, TestCrossCoreJoin, TestDistributedMissingSort, TestSimpleTrackingShardHandler, TestEmbeddedSolrServerConstructors, TestJettySolrRunner, ConnectionReuseTest, AssignTest, BaseCdcrDistributedZkTest, CdcrBootstrapTest, CollectionReloadTest, CollectionTooManyReplicasTest, ConfigSetsAPITest, CreateCollectionCleanupTest, CustomCollectionTest]
[junit4] Completed [506/727 (2!)] on J0 in 78.98s, 4 tests, 2 errors <<< FAILURES!
[...truncated 44159 lines...]
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 15 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/15/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
8 tests failed.
FAILED: org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI
Error Message:
Could not find collection : implicitcoll
Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : implicitcoll
at __randomizedtesting.SeedInfo.seed([2241743D59F39017:48A0FA566469266F]:0)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
at org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI(CustomCollectionTest.java:68)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestSSLRandomization.testRandomizedSslAndClientAuth
Error Message:
Could not find collection:first_collection
Stack Trace:
java.lang.AssertionError: Could not find collection:first_collection
at __randomizedtesting.SeedInfo.seed([2241743D59F39017:A915C55AFB6CD16B]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkCreateCollection(TestMiniSolrCloudClusterSSL.java:202)
at org.apache.solr.cloud.TestMiniSolrCloudClusterSSL.checkClusterWithCollectionCreations(TestMiniSolrCloudClusterSSL.java:172)
at org.apache.solr.cloud.TestSSLRandomization.testRandomizedSslAndClientAuth(TestSSLRandomization.java:50)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates
Error Message:
Could not find collection:test_col
Stack Trace:
java.lang.AssertionError: Could not find collection:test_col
at __randomizedtesting.SeedInfo.seed([2241743D59F39017]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.waitForRecoveriesToFinish(TestStressCloudBlindAtomicUpdates.java:459)
at org.apache.solr.cloud.TestStressCloudBlindAtomicUpdates.createMiniSolrCloudCluster(TestStressCloudBlindAtomicUpdates.java:134)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:847)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.TestPolicyCloud
Error Message:
java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO
Stack Trace:
org.apache.solr.common.SolrException: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO
at __randomizedtesting.SeedInfo.seed([2241743D59F39017]:0)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:171)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:117)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:112)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:99)
at org.apache.solr.cloud.MiniSolrCloudCluster.waitForAllNodes(MiniSolrCloudCluster.java:266)
at org.apache.solr.cloud.MiniSolrCloudCluster.<init>(MiniSolrCloudCluster.java:260)
at org.apache.solr.cloud.SolrCloudTestCase$Builder.configure(SolrCloudTestCase.java:190)
at org.apache.solr.cloud.autoscaling.TestPolicyCloud.setupCluster(TestPolicyCloud.java:58)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:847)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.io.IOException: Couldn't instantiate org.apache.zookeeper.ClientCnxnSocketNIO
at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1842)
at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:447)
at org.apache.zookeeper.ZooKeeper.<init>(ZooKeeper.java:380)
at org.apache.solr.common.cloud.SolrZooKeeper.<init>(SolrZooKeeper.java:43)
at org.apache.solr.common.cloud.ZkClientConnectionStrategy.createSolrZooKeeper(ZkClientConnectionStrategy.java:105)
at org.apache.solr.common.cloud.DefaultConnectionStrategy.connect(DefaultConnectionStrategy.java:37)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:146)
... 31 more
Caused by: java.io.IOException: Too many open files
at sun.nio.ch.IOUtil.makePipe(Native Method)
at sun.nio.ch.KQueueSelectorImpl.<init>(KQueueSelectorImpl.java:84)
at sun.nio.ch.KQueueSelectorProvider.openSelector(KQueueSelectorProvider.java:42)
at java.nio.channels.Selector.open(Selector.java:227)
at org.apache.zookeeper.ClientCnxnSocketNIO.<init>(ClientCnxnSocketNIO.java:43)
at sun.reflect.GeneratedConstructorAccessor199.newInstance(Unknown Source)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at java.lang.Class.newInstance(Class.java:442)
at org.apache.zookeeper.ZooKeeper.getClientCnxnSocket(ZooKeeper.java:1839)
... 37 more
FAILED: junit.framework.TestSuite.org.apache.solr.cloud.autoscaling.TestPolicyCloud
Error Message:
ObjectTracker found 21 object(s) that were not released!!! [SolrZkClient, SolrZkClient, InternalHttpClient, ZkController, SolrZkClient, InternalHttpClient, InternalHttpClient, InternalHttpClient, InternalHttpClient, ZkController, InternalHttpClient, ZkController, InternalHttpClient, ZkController, InternalHttpClient, Overseer, InternalHttpClient, SolrZkClient, SolrZkClient, ZkController, InternalHttpClient] org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185) at org.apache.solr.cloud.ZkController.<init>(ZkController.java:308) at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185) at org.apache.solr.cloud.ZkController.<init>(ZkController.java:308) at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.handler.component.HttpShardHandlerFactory.init(HttpShardHandlerFactory.java:209) at org.apache.solr.handler.component.ShardHandlerFactory.newInstance(ShardHandlerFactory.java:47) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:499) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.cloud.ZkController.<init>(ZkController.java:434) at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185) at org.apache.solr.cloud.ZkController.<init>(ZkController.java:308) at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.handler.component.HttpShardHandlerFactory.init(HttpShardHandlerFactory.java:209) at org.apache.solr.handler.component.ShardHandlerFactory.newInstance(ShardHandlerFactory.java:47) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:499) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.update.UpdateShardHandler.<init>(UpdateShardHandler.java:94) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:505) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.update.UpdateShardHandler.<init>(UpdateShardHandler.java:94) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:505) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.update.UpdateShardHandler.<init>(UpdateShardHandler.java:94) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:505) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.cloud.ZkController.<init>(ZkController.java:434) at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.handler.component.HttpShardHandlerFactory.init(HttpShardHandlerFactory.java:209) at org.apache.solr.handler.component.ShardHandlerFactory.newInstance(ShardHandlerFactory.java:47) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:499) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.cloud.ZkController.<init>(ZkController.java:434) at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.handler.component.HttpShardHandlerFactory.init(HttpShardHandlerFactory.java:209) at org.apache.solr.handler.component.ShardHandlerFactory.newInstance(ShardHandlerFactory.java:47) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:499) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.cloud.ZkController.<init>(ZkController.java:434) at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.update.UpdateShardHandler.<init>(UpdateShardHandler.java:94) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:505) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.Overseer at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.cloud.Overseer.start(Overseer.java:534) at org.apache.solr.cloud.OverseerElectionContext.runLeaderProcess(ElectionContext.java:774) at org.apache.solr.cloud.LeaderElector.runIamLeaderProcess(LeaderElector.java:170) at org.apache.solr.cloud.LeaderElector.checkIfIamLeader(LeaderElector.java:135) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:307) at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:216) at org.apache.solr.cloud.ZkController.init(ZkController.java:745) at org.apache.solr.cloud.ZkController.<init>(ZkController.java:432) at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.update.UpdateShardHandler.<init>(UpdateShardHandler.java:94) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:505) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185) at org.apache.solr.cloud.ZkController.<init>(ZkController.java:308) at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185) at org.apache.solr.cloud.ZkController.<init>(ZkController.java:308) at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.cloud.ZkController.<init>(ZkController.java:434) at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748) org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42) at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289) at org.apache.solr.handler.component.HttpShardHandlerFactory.init(HttpShardHandlerFactory.java:209) at org.apache.solr.handler.component.ShardHandlerFactory.newInstance(ShardHandlerFactory.java:47) at org.apache.solr.core.CoreContainer.load(CoreContainer.java:499) at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261) at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181) at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137) at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873) at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565) at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599) at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285) at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130) at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448) at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306) at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179) at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394) at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367) at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382) at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:748)
Stack Trace:
java.lang.AssertionError: ObjectTracker found 21 object(s) that were not released!!! [SolrZkClient, SolrZkClient, InternalHttpClient, ZkController, SolrZkClient, InternalHttpClient, InternalHttpClient, InternalHttpClient, InternalHttpClient, ZkController, InternalHttpClient, ZkController, InternalHttpClient, ZkController, InternalHttpClient, Overseer, InternalHttpClient, SolrZkClient, SolrZkClient, ZkController, InternalHttpClient]
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185)
at org.apache.solr.cloud.ZkController.<init>(ZkController.java:308)
at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515)
at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261)
at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181)
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382)
at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185)
at org.apache.solr.cloud.ZkController.<init>(ZkController.java:308)
at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515)
at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261)
at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181)
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382)
at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
at org.apache.solr.handler.component.HttpShardHandlerFactory.init(HttpShardHandlerFactory.java:209)
at org.apache.solr.handler.component.ShardHandlerFactory.newInstance(ShardHandlerFactory.java:47)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:499)
at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261)
at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181)
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382)
at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.cloud.ZkController.<init>(ZkController.java:434)
at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515)
at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261)
at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181)
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382)
at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.common.cloud.SolrZkClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.common.cloud.SolrZkClient.<init>(SolrZkClient.java:185)
at org.apache.solr.cloud.ZkController.<init>(ZkController.java:308)
at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515)
at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261)
at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181)
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382)
at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
at org.apache.solr.handler.component.HttpShardHandlerFactory.init(HttpShardHandlerFactory.java:209)
at org.apache.solr.handler.component.ShardHandlerFactory.newInstance(ShardHandlerFactory.java:47)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:499)
at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261)
at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181)
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382)
at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
at org.apache.solr.update.UpdateShardHandler.<init>(UpdateShardHandler.java:94)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:505)
at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261)
at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181)
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382)
at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
at org.apache.solr.update.UpdateShardHandler.<init>(UpdateShardHandler.java:94)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:505)
at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261)
at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181)
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382)
at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.client.solrj.impl.HttpClientUtil.createClient(HttpClientUtil.java:289)
at org.apache.solr.update.UpdateShardHandler.<init>(UpdateShardHandler.java:94)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:505)
at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261)
at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181)
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382)
at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.solr.cloud.ZkController
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.cloud.ZkController.<init>(ZkController.java:434)
at org.apache.solr.core.ZkContainer.initZooKeeper(ZkContainer.java:112)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:515)
at org.apache.solr.servlet.SolrDispatchFilter.createCoreContainer(SolrDispatchFilter.java:261)
at org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:181)
at org.eclipse.jetty.servlet.FilterHolder.initialize(FilterHolder.java:137)
at org.eclipse.jetty.servlet.ServletHandler.initialize(ServletHandler.java:873)
at org.eclipse.jetty.servlet.ServletHandler.updateMappings(ServletHandler.java:1565)
at org.eclipse.jetty.servlet.ServletHandler.setFilterMappings(ServletHandler.java:1599)
at org.eclipse.jetty.servlet.ServletHandler.addFilterMapping(ServletHandler.java:1285)
at org.eclipse.jetty.servlet.ServletHandler.addFilterWithMapping(ServletHandler.java:1130)
at org.eclipse.jetty.servlet.ServletContextHandler.addFilter(ServletContextHandler.java:448)
at org.apache.solr.client.solrj.embedded.JettySolrRunner$1.lifeCycleStarted(JettySolrRunner.java:306)
at org.eclipse.jetty.util.component.AbstractLifeCycle.setStarted(AbstractLifeCycle.java:179)
at org.eclipse.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:69)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:394)
at org.apache.solr.client.solrj.embedded.JettySolrRunner.start(JettySolrRunner.java:367)
at org.apache.solr.cloud.MiniSolrCloudCluster.startJettySolrRunner(MiniSolrCloudCluster.java:382)
at org.apache.solr.cloud.MiniSolrCloudCluster.lambda$new$0(MiniSolrCloudCluster.java:245)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:188)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
org.apache.solr.common.util.ObjectReleaseTracker$ObjectTrackerException: org.apache.http.impl.client.InternalHttpClient
at org.apache.solr.common.util.ObjectReleaseTracker.track(ObjectReleaseTracker.java:42)
at org.apache.solr.clie
[...truncated too long message...]
junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 24) Thread[id=20045, name=org.eclipse.jetty.server.session.HashSessionManager@6fdbcafTimer, state=TIMED_WAITING, group=TGRP-TestPolicyCloud]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 25) Thread[id=20028, name=qtp577182276-20028, state=RUNNABLE, group=TGRP-TestPolicyCloud]
[junit4] > at sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method)
[junit4] > at sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:198)
[junit4] > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:117)
[junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
[junit4] > at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 26) Thread[id=20105, name=jetty-launcher-3296-thread-1-SendThread(127.0.0.1:51685), state=TIMED_WAITING, group=TGRP-TestPolicyCloud]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.client.StaticHostProvider.next(StaticHostProvider.java:101)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.startConnect(ClientCnxn.java:997)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1060)
[junit4] > 27) Thread[id=20109, name=zkCallback-3322-thread-1, state=TIMED_WAITING, group=TGRP-TestPolicyCloud]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 28) Thread[id=20037, name=qtp1638793387-20037, state=RUNNABLE, group=TGRP-TestPolicyCloud]
[junit4] > at sun.nio.ch.KQueueArrayWrapper.interrupt(Native Method)
[junit4] > at sun.nio.ch.KQueueArrayWrapper.interrupt(KQueueArrayWrapper.java:203)
[junit4] > at sun.nio.ch.KQueueSelectorImpl.wakeup(KQueueSelectorImpl.java:257)
[junit4] > at java.nio.channels.spi.AbstractSelector$1.interrupt(AbstractSelector.java:213)
[junit4] > at java.nio.channels.spi.AbstractSelector.begin(AbstractSelector.java:219)
[junit4] > at sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:116)
[junit4] > at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97)
[junit4] > at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:101)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.select(ManagedSelector.java:243)
[junit4] > at org.eclipse.jetty.io.ManagedSelector$SelectorProducer.produce(ManagedSelector.java:191)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.executeProduceConsume(ExecuteProduceConsume.java:249)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.produceConsume(ExecuteProduceConsume.java:148)
[junit4] > at org.eclipse.jetty.util.thread.strategy.ExecuteProduceConsume.execute(ExecuteProduceConsume.java:100)
[junit4] > at org.eclipse.jetty.io.ManagedSelector.run(ManagedSelector.java:147)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:671)
[junit4] > at org.eclipse.jetty.util.thread.QueuedThreadPool$2.run(QueuedThreadPool.java:589)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 29) Thread[id=20006, name=jetty-launcher-3296-thread-1, state=TIMED_WAITING, group=TGRP-TestPolicyCloud]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 30) Thread[id=20050, name=org.eclipse.jetty.server.session.HashSessionManager@57fc61b2Timer, state=TIMED_WAITING, group=TGRP-TestPolicyCloud]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093)
[junit4] > at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1067)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > 31) Thread[id=20096, name=jetty-launcher-3296-thread-4-SendThread(127.0.0.1:51685), state=TIMED_WAITING, group=TGRP-TestPolicyCloud]
[junit4] > at java.lang.Thread.sleep(Native Method)
[junit4] > at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1051)
[junit4] > 32) Thread[id=20103, name=zkCallback-3317-thread-1, state=TIMED_WAITING, group=TGRP-TestPolicyCloud]
[junit4] > at sun.misc.Unsafe.park(Native Method)
[junit4] > at java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460)
[junit4] > at java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362)
[junit4] > at java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1066)
[junit4] > at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1127)
[junit4] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] > at __randomizedtesting.SeedInfo.seed([2241743D59F39017]:0)
[junit4] Completed [537/727 (5!)] on J1 in 45.51s, 0 tests, 1 failure, 3 errors <<< FAILURES!
[...truncated 44000 lines...]
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 14 -
Still Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/14/
Java: 64bit/jdk1.8.0 -XX:-UseCompressedOops -XX:+UseParallelGC
4 tests failed.
FAILED: org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDocAbsent
Error Message:
Did not find the expected number of groups for field intGSF expected:<4> but was:<3>
Stack Trace:
java.lang.AssertionError: Did not find the expected number of groups for field intGSF expected:<4> but was:<3>
at __randomizedtesting.SeedInfo.seed([E3CBA08B85F8D8DC:3D7C7B0360A99819]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotEquals(Assert.java:647)
at org.junit.Assert.assertEquals(Assert.java:128)
at org.junit.Assert.assertEquals(Assert.java:472)
at org.apache.solr.cloud.DocValuesNotIndexedTest.testGroupingDocAbsent(DocValuesNotIndexedTest.java:304)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test
Error Message:
Could not find collection:collection2
Stack Trace:
java.lang.AssertionError: Could not find collection:collection2
at __randomizedtesting.SeedInfo.seed([E3CBA08B85F8D8DC:6B9F9F512B04B524]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertNotNull(Assert.java:526)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:155)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:140)
at org.apache.solr.cloud.AbstractDistribZkTestBase.waitForRecoveriesToFinish(AbstractDistribZkTestBase.java:135)
at org.apache.solr.cloud.AbstractFullDistribZkTestBase.waitForRecoveriesToFinish(AbstractFullDistribZkTestBase.java:907)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.testIndexingBatchPerRequestWithHttpSolrClient(FullSolrCloudDistribCmdsTest.java:612)
at org.apache.solr.cloud.FullSolrCloudDistribCmdsTest.test(FullSolrCloudDistribCmdsTest.java:152)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.MultiThreadedOCPTest.test
Error Message:
Task 3001 did not complete, final state: FAILED expected same:<COMPLETED> was not:<FAILED>
Stack Trace:
java.lang.AssertionError: Task 3001 did not complete, final state: FAILED expected same:<COMPLETED> was not:<FAILED>
at __randomizedtesting.SeedInfo.seed([E3CBA08B85F8D8DC:6B9F9F512B04B524]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.failNotSame(Assert.java:641)
at org.junit.Assert.assertSame(Assert.java:580)
at org.apache.solr.cloud.MultiThreadedOCPTest.testDeduplicationOfSubmittedTasks(MultiThreadedOCPTest.java:226)
at org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:64)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.TestCloudRecovery.corruptedLogTest
Error Message:
Timeout waiting for all live and active
Stack Trace:
java.lang.AssertionError: Timeout waiting for all live and active
at __randomizedtesting.SeedInfo.seed([E3CBA08B85F8D8DC:60BDFF795381D67D]:0)
at org.junit.Assert.fail(Assert.java:93)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.apache.solr.cloud.TestCloudRecovery.corruptedLogTest(TestCloudRecovery.java:184)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11869 lines...]
[junit4] Suite: org.apache.solr.cloud.TestCloudRecovery
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/init-core-data-001
[junit4] 2> 989641 WARN (SUITE-TestCloudRecovery-seed#[E3CBA08B85F8D8DC]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=83 numCloses=83
[junit4] 2> 989641 INFO (SUITE-TestCloudRecovery-seed#[E3CBA08B85F8D8DC]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=true
[junit4] 2> 989644 INFO (SUITE-TestCloudRecovery-seed#[E3CBA08B85F8D8DC]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 989644 INFO (SUITE-TestCloudRecovery-seed#[E3CBA08B85F8D8DC]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 2 servers in /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/tempDir-001
[junit4] 2> 989645 INFO (SUITE-TestCloudRecovery-seed#[E3CBA08B85F8D8DC]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 989645 INFO (Thread-2143) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 989645 INFO (Thread-2143) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 989647 ERROR (Thread-2143) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 989752 INFO (SUITE-TestCloudRecovery-seed#[E3CBA08B85F8D8DC]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:62958
[junit4] 2> 989841 INFO (jetty-launcher-1928-thread-1) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 989842 INFO (jetty-launcher-1928-thread-2) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@64d0e975{/solr,null,AVAILABLE}
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@401de5f{/solr,null,AVAILABLE}
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@6eb8a980{HTTP/1.1,[http/1.1]}{127.0.0.1:62961}
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@5a61f95d{HTTP/1.1,[http/1.1]}{127.0.0.1:62960}
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-1) [ ] o.e.j.s.Server Started @993694ms
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-2) [ ] o.e.j.s.Server Started @993694ms
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=62961}
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=62960}
[junit4] 2> 989844 ERROR (jetty-launcher-1928-thread-1) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 989844 ERROR (jetty-launcher-1928-thread-2) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 989844 INFO (jetty-launcher-1928-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 989845 INFO (jetty-launcher-1928-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 989845 INFO (jetty-launcher-1928-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 989845 INFO (jetty-launcher-1928-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T17:12:40.470Z
[junit4] 2> 989845 INFO (jetty-launcher-1928-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T17:12:40.470Z
[junit4] 2> 989847 INFO (jetty-launcher-1928-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 989847 INFO (jetty-launcher-1928-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 989857 INFO (jetty-launcher-1928-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62958/solr
[junit4] 2> 989857 INFO (jetty-launcher-1928-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62958/solr
[junit4] 2> 990006 INFO (jetty-launcher-1928-thread-2) [n:127.0.0.1:62960_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 990006 INFO (jetty-launcher-1928-thread-1) [n:127.0.0.1:62961_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 990007 INFO (jetty-launcher-1928-thread-2) [n:127.0.0.1:62960_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:62960_solr
[junit4] 2> 990008 INFO (jetty-launcher-1928-thread-1) [n:127.0.0.1:62961_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62961_solr
[junit4] 2> 990008 INFO (jetty-launcher-1928-thread-2) [n:127.0.0.1:62960_solr ] o.a.s.c.Overseer Overseer (id=98267795309920261-127.0.0.1:62960_solr-n_0000000000) starting
[junit4] 2> 990009 INFO (zkCallback-1940-thread-1-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 990010 INFO (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 990039 INFO (jetty-launcher-1928-thread-2) [n:127.0.0.1:62960_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62960_solr
[junit4] 2> 990041 INFO (zkCallback-1940-thread-1-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 990042 INFO (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 990148 INFO (jetty-launcher-1928-thread-2) [n:127.0.0.1:62960_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62960.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@628a1c3f
[junit4] 2> 990150 INFO (jetty-launcher-1928-thread-1) [n:127.0.0.1:62961_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62961.solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@628a1c3f
[junit4] 2> 990152 INFO (jetty-launcher-1928-thread-1) [n:127.0.0.1:62961_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62961.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@628a1c3f
[junit4] 2> 990152 INFO (jetty-launcher-1928-thread-1) [n:127.0.0.1:62961_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62961.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@628a1c3f
[junit4] 2> 990153 INFO (jetty-launcher-1928-thread-1) [n:127.0.0.1:62961_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/tempDir-001/node1/.
[junit4] 2> 990157 INFO (jetty-launcher-1928-thread-2) [n:127.0.0.1:62960_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62960.solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@628a1c3f
[junit4] 2> 990157 INFO (jetty-launcher-1928-thread-2) [n:127.0.0.1:62960_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62960.solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@628a1c3f
[junit4] 2> 990157 INFO (jetty-launcher-1928-thread-2) [n:127.0.0.1:62960_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/tempDir-001/node2/.
[junit4] 2> 990187 INFO (SUITE-TestCloudRecovery-seed#[E3CBA08B85F8D8DC]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 990189 INFO (SUITE-TestCloudRecovery-seed#[E3CBA08B85F8D8DC]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:62958/solr ready
[junit4] 2> 990196 INFO (qtp198392759-10797) [n:127.0.0.1:62960_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params pullReplicas=0&replicationFactor=2&collection.configName=config&maxShardsPerNode=2&name=collection1&nrtReplicas=2&action=CREATE&numShards=2&tlogReplicas=0&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 990198 INFO (OverseerThreadFactory-5283-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.CreateCollectionCmd Create collection collection1
[junit4] 2> 990310 INFO (OverseerStateUpdate-98267795309920261-127.0.0.1:62960_solr-n_0000000000) [n:127.0.0.1:62960_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:62960/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 990312 INFO (OverseerStateUpdate-98267795309920261-127.0.0.1:62960_solr-n_0000000000) [n:127.0.0.1:62960_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"collection1_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:62961/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 990314 INFO (OverseerStateUpdate-98267795309920261-127.0.0.1:62960_solr-n_0000000000) [n:127.0.0.1:62960_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"collection1_shard2_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:62960/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 990316 INFO (OverseerStateUpdate-98267795309920261-127.0.0.1:62960_solr-n_0000000000) [n:127.0.0.1:62960_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"collection1",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"collection1_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:62961/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 990518 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node1&collection.configName=config&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 990519 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=collection1_shard2_replica_n1&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 990519 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 990519 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=config&newCollection=true&name=collection1_shard1_replica_n2&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 990521 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 990521 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=collection1_shard2_replica_n2&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 990634 INFO (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 990634 INFO (zkCallback-1940-thread-1-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 990635 INFO (zkCallback-1939-thread-2-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 990635 INFO (zkCallback-1940-thread-2-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 991540 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 991540 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 991547 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 991548 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 991564 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.s.IndexSchema [collection1_shard1_replica_n2] Schema name=minimal
[junit4] 2> 991567 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 991567 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n2' using configuration from collection collection1, trusted=true
[junit4] 2> 991568 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62961.solr.core.collection1.shard1.replica_n2' (registry 'solr.core.collection1.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@628a1c3f
[junit4] 2> 991568 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 991568 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore [[collection1_shard1_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/tempDir-001/node1/collection1_shard1_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/tempDir-001/node1/./collection1_shard1_replica_n2/data/]
[junit4] 2> 991569 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.s.IndexSchema [collection1_shard2_replica_n2] Schema name=minimal
[junit4] 2> 991570 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 991570 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n2' using configuration from collection collection1, trusted=true
[junit4] 2> 991571 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62961.solr.core.collection1.shard2.replica_n2' (registry 'solr.core.collection1.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@628a1c3f
[junit4] 2> 991571 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 991571 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SolrCore [[collection1_shard2_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/tempDir-001/node1/collection1_shard2_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/tempDir-001/node1/./collection1_shard2_replica_n2/data/]
[junit4] 2> 991575 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema [collection1_shard1_replica_n1] Schema name=minimal
[junit4] 2> 991576 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 991576 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard1_replica_n1' using configuration from collection collection1, trusted=true
[junit4] 2> 991577 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62960.solr.core.collection1.shard1.replica_n1' (registry 'solr.core.collection1.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@628a1c3f
[junit4] 2> 991577 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 991577 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [[collection1_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/tempDir-001/node2/collection1_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/tempDir-001/node2/./collection1_shard1_replica_n1/data/]
[junit4] 2> 991580 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.s.IndexSchema [collection1_shard2_replica_n1] Schema name=minimal
[junit4] 2> 991582 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 991582 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'collection1_shard2_replica_n1' using configuration from collection collection1, trusted=true
[junit4] 2> 991582 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr_62960.solr.core.collection1.shard2.replica_n1' (registry 'solr.core.collection1.shard2.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@628a1c3f
[junit4] 2> 991582 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 991582 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.SolrCore [[collection1_shard2_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/tempDir-001/node2/collection1_shard2_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.TestCloudRecovery_E3CBA08B85F8D8DC-001/tempDir-001/node2/./collection1_shard2_replica_n1/data/]
[junit4] 2> 991656 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 991656 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 991657 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 991657 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 991676 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 991677 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 991695 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 991695 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 991695 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@14d724c3[collection1_shard2_replica_n1] main]
[junit4] 2> 991696 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 991696 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 991697 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 991697 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 991698 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 991698 INFO (searcherExecutor-5291-thread-1-processing-n:127.0.0.1:62960_solr x:collection1_shard2_replica_n1 s:shard2 c:collection1 r:core_node3) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.SolrCore [collection1_shard2_replica_n1] Registered new searcher Searcher@14d724c3[collection1_shard2_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 991698 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572284727110402048
[junit4] 2> 991699 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 991699 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 991706 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard2: total=2 found=1 timeoutin=9999ms
[junit4] 2> 991713 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 991713 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 991714 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 991714 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 991720 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@2e7d9c55[collection1_shard1_replica_n2] main]
[junit4] 2> 991721 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 991722 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 991722 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 991723 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572284727136616448
[junit4] 2> 991723 INFO (searcherExecutor-5288-thread-1-processing-n:127.0.0.1:62961_solr x:collection1_shard1_replica_n2 s:shard1 c:collection1 r:core_node2) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore [collection1_shard1_replica_n2] Registered new searcher Searcher@2e7d9c55[collection1_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 991726 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@369677ad[collection1_shard1_replica_n1] main]
[junit4] 2> 991728 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 991728 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 991729 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Waiting until we see more replicas up for shard shard1: total=2 found=1 timeoutin=9999ms
[junit4] 2> 991730 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 991731 INFO (searcherExecutor-5290-thread-1-processing-n:127.0.0.1:62960_solr x:collection1_shard1_replica_n1 s:shard1 c:collection1 r:core_node1) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [collection1_shard1_replica_n1] Registered new searcher Searcher@369677ad[collection1_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 991731 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572284727145005056
[junit4] 2> 991739 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@7d01995b[collection1_shard2_replica_n2] main]
[junit4] 2> 991740 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/config
[junit4] 2> 991740 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/config
[junit4] 2> 991741 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 991741 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572284727155490816
[junit4] 2> 991741 INFO (searcherExecutor-5289-thread-1-processing-n:127.0.0.1:62961_solr x:collection1_shard2_replica_n2 s:shard2 c:collection1 r:core_node4) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SolrCore [collection1_shard2_replica_n2] Registered new searcher Searcher@7d01995b[collection1_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 991842 INFO (zkCallback-1940-thread-2-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 991842 INFO (zkCallback-1939-thread-2-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 991842 INFO (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 991842 INFO (zkCallback-1940-thread-1-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992209 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 992209 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 992209 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:62960/solr/collection1_shard2_replica_n1/
[junit4] 2> 992209 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.PeerSync PeerSync: core=collection1_shard2_replica_n1 url=http://127.0.0.1:62960/solr START replicas=[http://127.0.0.1:62961/solr/collection1_shard2_replica_n2/] nUpdates=100
[junit4] 2> 992210 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.PeerSync PeerSync: core=collection1_shard2_replica_n1 url=http://127.0.0.1:62960/solr DONE. We have no versions. sync failed.
[junit4] 2> 992211 INFO (qtp91054759-10794) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 992211 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 992212 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 992212 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 992216 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:62960/solr/collection1_shard2_replica_n1/ shard2
[junit4] 2> 992238 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 992238 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 992238 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:62961/solr/collection1_shard1_replica_n2/
[junit4] 2> 992238 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n2 url=http://127.0.0.1:62961/solr START replicas=[http://127.0.0.1:62960/solr/collection1_shard1_replica_n1/] nUpdates=100
[junit4] 2> 992239 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=collection1_shard1_replica_n2 url=http://127.0.0.1:62961/solr DONE. We have no versions. sync failed.
[junit4] 2> 992240 INFO (qtp198392759-10801) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 992241 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 992241 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 992241 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 992247 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:62961/solr/collection1_shard1_replica_n2/ shard1
[junit4] 2> 992350 INFO (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992350 INFO (zkCallback-1939-thread-2-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992350 INFO (zkCallback-1940-thread-1-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992350 INFO (zkCallback-1940-thread-2-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992360 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 992362 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=config&newCollection=true&name=collection1_shard1_replica_n2&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1842
[junit4] 2> 992380 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 992383 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=config&newCollection=true&name=collection1_shard2_replica_n1&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=1864
[junit4] 2> 992489 INFO (zkCallback-1940-thread-2-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992489 INFO (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992490 INFO (zkCallback-1940-thread-1-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992489 INFO (zkCallback-1939-thread-2-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992745 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node1&collection.configName=config&newCollection=true&name=collection1_shard1_replica_n1&action=CREATE&numShards=2&collection=collection1&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2227
[junit4] 2> 992747 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=config&newCollection=true&name=collection1_shard2_replica_n2&action=CREATE&numShards=2&collection=collection1&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2226
[junit4] 2> 992750 INFO (qtp198392759-10797) [n:127.0.0.1:62960_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 992863 INFO (zkCallback-1940-thread-1-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992863 INFO (zkCallback-1940-thread-2-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992863 INFO (zkCallback-1939-thread-2-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 992864 INFO (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/collection1/state.json] for collection [collection1] has occurred - updating... (live nodes size: [2])
[junit4] 2> 993754 INFO (qtp198392759-10797) [n:127.0.0.1:62960_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={pullReplicas=0&replicationFactor=2&collection.configName=config&maxShardsPerNode=2&name=collection1&nrtReplicas=2&action=CREATE&numShards=2&tlogReplicas=0&wt=javabin&version=2} status=0 QTime=3558
[junit4] 2> 993755 INFO (SUITE-TestCloudRecovery-seed#[E3CBA08B85F8D8DC]-worker) [ ] o.a.s.c.AbstractDistribZkTestBase Wait for recoveries to finish - collection: collection1 failOnTimeout:true timeout (sec):30
[junit4] 2> 993755 INFO (SUITE-TestCloudRecovery-seed#[E3CBA08B85F8D8DC]-worker) [ ] o.a.s.c.AbstractDistribZkTestBase Recoveries finished - collection: collection1
[junit4] 2> 993767 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.SolrTestCaseJ4 ###Starting leaderRecoverFromLogOnStartupTest
[junit4] 2> 993776 INFO (qtp198392759-10795) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&_version_=-1572284729283051520&distrib.from=http://127.0.0.1:62961/solr/collection1_shard1_replica_n2/&wt=javabin&version=2}{deleteByQuery=*:* (-1572284729283051520)} 0 1
[junit4] 2> 993776 INFO (qtp91054759-10803) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n2] webapp=/solr path=/update params={update.distrib=TOLEADER&distrib.from=http://127.0.0.1:62960/solr/collection1_shard2_replica_n1/&wt=javabin&version=2}{deleteByQuery=*:* (-1572284729283051520)} 0 5
[junit4] 2> 993776 INFO (qtp91054759-10804) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&_version_=-1572284729282002944&distrib.from=http://127.0.0.1:62960/solr/collection1_shard2_replica_n1/&wt=javabin&version=2}{deleteByQuery=*:* (-1572284729282002944)} 0 2
[junit4] 2> 993777 INFO (qtp198392759-10802) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{deleteByQuery=*:* (-1572284729282002944)} 0 8
[junit4] 2> 993778 INFO (qtp91054759-10792) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1572284729291440128,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 993778 INFO (qtp91054759-10792) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 993778 INFO (qtp198392759-10801) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1572284729291440128,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 993778 INFO (qtp198392759-10801) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 993780 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1572284729293537280,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 993780 INFO (qtp91054759-10792) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 993780 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 993780 INFO (qtp198392759-10801) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 993781 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 993781 INFO (qtp91054759-10793) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 start commit{_version_=1572284729294585856,optimize=false,openSearcher=true,waitSearcher=true,expungeDeletes=false,softCommit=false,prepareCommit=false}
[junit4] 2> 993781 INFO (qtp91054759-10793) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 No uncommitted changes. Skipping IW.commit.
[junit4] 2> 993781 INFO (qtp198392759-10801) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:62960/solr/collection1_shard2_replica_n1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 2
[junit4] 2> 993781 INFO (qtp91054759-10793) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.DirectUpdateHandler2 end_commit_flush
[junit4] 2> 993781 INFO (qtp91054759-10792) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:62960/solr/collection1_shard2_replica_n1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 3
[junit4] 2> 993781 INFO (qtp198392759-10799) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:62960/solr/collection1_shard2_replica_n1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 1
[junit4] 2> 993781 INFO (qtp91054759-10793) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&waitSearcher=true&openSearcher=true&commit=true&softCommit=false&distrib.from=http://127.0.0.1:62960/solr/collection1_shard2_replica_n1/&commit_end_point=true&wt=javabin&version=2&expungeDeletes=false}{commit=} 0 0
[junit4] 2> 993781 INFO (qtp198392759-10800) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n1] webapp=/solr path=/update params={_stateVer_=collection1:6&waitSearcher=true&commit=true&softCommit=false&wt=javabin&version=2}{commit=} 0 4
[junit4] 2> 993786 INFO (qtp198392759-10798) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:62961/solr/collection1_shard1_replica_n2/&wt=javabin&version=2}{add=[1 (1572284729296683008)]} 0 1
[junit4] 2> 993787 INFO (qtp91054759-10789) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[1 (1572284729296683008)]} 0 3
[junit4] 2> 993790 INFO (qtp91054759-10791) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:62960/solr/collection1_shard2_replica_n1/&wt=javabin&version=2}{add=[2 (1572284729301925888)]} 0 1
[junit4] 2> 993791 INFO (qtp198392759-10797) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[2 (1572284729301925888)]} 0 3
[junit4] 2> 993792 INFO (qtp91054759-10803) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n2] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:62960/solr/collection1_shard2_replica_n1/&wt=javabin&version=2}{add=[3 (1572284729305071616)]} 0 0
[junit4] 2> 993792 INFO (qtp198392759-10795) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard2_replica_n1] webapp=/solr path=/update params={wt=javabin&version=2}{add=[3 (1572284729305071616)]} 0 0
[junit4] 2> 993793 INFO (qtp198392759-10802) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n1] webapp=/solr path=/update params={update.distrib=FROMLEADER&distrib.from=http://127.0.0.1:62961/solr/collection1_shard1_replica_n2/&wt=javabin&version=2}{add=[4 (1572284729307168768)]} 0 0
[junit4] 2> 993793 INFO (qtp91054759-10804) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.u.p.LogUpdateProcessorFactory [collection1_shard1_replica_n2] webapp=/solr path=/update params={wt=javabin&version=2}{add=[4 (1572284729307168768)]} 0 0
[junit4] 2> 993795 INFO (qtp198392759-10801) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.S.Request [collection1_shard2_replica_n1] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=collection1:6&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:62960/solr/collection1_shard2_replica_n1/|http://127.0.0.1:62961/solr/collection1_shard2_replica_n2/&rows=10&version=2&q=*:*&NOW=1499447564419&isShard=true&wt=javabin} hits=0 status=0 QTime=0
[junit4] 2> 993795 INFO (qtp198392759-10800) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.c.S.Request [collection1_shard1_replica_n1] webapp=/solr path=/select params={df=text&distrib=false&_stateVer_=collection1:6&fl=id&fl=score&shards.purpose=4&start=0&fsv=true&shard.url=http://127.0.0.1:62960/solr/collection1_shard1_replica_n1/|http://127.0.0.1:62961/solr/collection1_shard1_replica_n2/&rows=10&version=2&q=*:*&NOW=1499447564419&isShard=true&wt=javabin} hits=0 status=0 QTime=0
[junit4] 2> 993796 INFO (qtp91054759-10792) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.S.Request [collection1_shard2_replica_n2] webapp=/solr path=/select params={q=*:*&_stateVer_=collection1:6&wt=javabin&version=2} hits=0 status=0 QTime=1
[junit4] 2> 993796 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 62961
[junit4] 2> 993796 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1445801497
[junit4] 2> 993796 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 993798 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 993799 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 993800 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 993801 INFO (coreCloseExecutor-5308-thread-1) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.c.SolrCore [collection1_shard1_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@5a4c41aa
[junit4] 2> 993801 INFO (coreCloseExecutor-5308-thread-2) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.c.SolrCore [collection1_shard2_replica_n2] CLOSING SolrCore org.apache.solr.core.SolrCore@62d29fba
[junit4] 2> 993802 INFO (coreCloseExecutor-5308-thread-2) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard2.replica_n2, tag=1657970618
[junit4] 2> 993805 INFO (coreCloseExecutor-5308-thread-2) [n:127.0.0.1:62961_solr c:collection1 s:shard2 r:core_node4 x:collection1_shard2_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard2.leader, tag=1657970618
[junit4] 2> 993805 INFO (coreCloseExecutor-5308-thread-1) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n2, tag=1514946986
[junit4] 2> 993807 INFO (coreCloseExecutor-5308-thread-1) [n:127.0.0.1:62961_solr c:collection1 s:shard1 r:core_node2 x:collection1_shard1_replica_n2] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=1514946986
[junit4] 2> 993808 WARN (zkCallback-1940-thread-2-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 993809 INFO (zkCallback-1939-thread-2-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 993809 INFO (zkCallback-1946-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (1)
[junit4] 2> 993809 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@6eb8a980{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 993810 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@401de5f{/solr,null,UNAVAILABLE}
[junit4] 2> 993810 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.c.ChaosMonkey monkey: stop jetty! 62960
[junit4] 2> 993810 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.c.CoreContainer Shutting down CoreContainer instance=2050588498
[junit4] 2> 993811 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node, tag=null
[junit4] 2> 993811 INFO (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 993812 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 993813 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 993814 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 993815 INFO (coreCloseExecutor-5310-thread-1) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.c.SolrCore [collection1_shard2_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@6042e001
[junit4] 2> 993817 INFO (coreCloseExecutor-5310-thread-1) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard2.replica_n1, tag=1614995457
[junit4] 2> 993819 INFO (coreCloseExecutor-5310-thread-1) [n:127.0.0.1:62960_solr c:collection1 s:shard2 r:core_node3 x:collection1_shard2_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard2.leader, tag=1614995457
[junit4] 2> 993820 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.c.Overseer Overseer (id=98267795309920261-127.0.0.1:62960_solr-n_0000000000) closing
[junit4] 2> 993820 INFO (OverseerStateUpdate-98267795309920261-127.0.0.1:62960_solr-n_0000000000) [n:127.0.0.1:62960_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:62960_solr
[junit4] 2> 993821 WARN (zkCallback-1939-thread-2-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 993822 INFO (zkCallback-1946-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0)
[junit4] 2> 996322 WARN (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.c.SyncStrategy Closed, skipping sync up.
[junit4] 2> 996322 INFO (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.c.SolrCore [collection1_shard1_replica_n1] CLOSING SolrCore org.apache.solr.core.SolrCore@3451c7cf
[junit4] 2> 996334 INFO (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.core.collection1.shard1.replica_n1, tag=877774799
[junit4] 2> 996339 INFO (zkCallback-1939-thread-1-processing-n:127.0.0.1:62960_solr) [n:127.0.0.1:62960_solr c:collection1 s:shard1 r:core_node1 x:collection1_shard1_replica_n1] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.collection.collection1.shard1.leader, tag=877774799
[junit4] 2> 996340 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@5a61f95d{HTTP/1.1,[http/1.1]}{127.0.0.1:0}
[junit4] 2> 996341 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@64d0e975{/solr,null,UNAVAILABLE}
[junit4] 2> 996344 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.c.ChaosMonkey monkey: starting jetty! 62961
[junit4] 2> 996344 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 996348 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@70e2ed0e{/solr,null,AVAILABLE}
[junit4] 2> 996348 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.e.j.s.AbstractConnector Started ServerConnector@4c34f011{HTTP/1.1,[http/1.1]}{127.0.0.1:62961}
[junit4] 2> 996349 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.e.j.s.Server Started @1000199ms
[junit4] 2> 996349 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=62961}
[junit4] 2> 996350 ERROR (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 996350 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr? version 7.1.0
[junit4] 2> 996350 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 996350 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 996350 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T17:12:46.975Z
[junit4] 2> 996354 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 996372 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:62958/solr
[junit4] 2> 996393 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [n:127.0.0.1:62961_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 996394 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [n:127.0.0.1:62961_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:62961_solr
[junit4] 2> 996395 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [n:127.0.0.1:62961_solr ] o.a.s.c.Overseer Overseer (id=98267795309920267-127.0.0.1:62961_solr-n_0000000002) starting
[junit4] 2> 996403 INFO (TEST-TestCloudRecovery.leaderRecoverFromLogOnStartupTest-seed#[E3CBA08B85F8D8DC]) [n:127.0.0.1:62961_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:62961_solr
[junit4] 2> 996404 INFO (zkCallback-1946-thread-1) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 996405 INFO (zkCallback-1951-thread-1-processing-n:127.0.0.1:62961_solr) [n:127.0.0.1:62961_solr
[...truncated too long message...]
unit4] 2> 1893343 INFO (OverseerStateUpdate-98267852010160147-127.0.0.1:49292_l_tt%2Fna-n_0000000004) [n:127.0.0.1:49292_l_tt%2Fna ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:49292_l_tt%2Fna
[junit4] 2> 1893344 WARN (zkCallback-2866-thread-1-processing-n:127.0.0.1:49292_l_tt%2Fna) [n:127.0.0.1:49292_l_tt%2Fna ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1893346 INFO (TEST-MultiThreadedOCPTest.test-seed#[E3CBA08B85F8D8DC]) [ ] o.e.j.s.AbstractConnector Stopped ServerConnector@f4039ae{SSL,[ssl, http/1.1]}{127.0.0.1:0}
[junit4] 2> 1893346 INFO (TEST-MultiThreadedOCPTest.test-seed#[E3CBA08B85F8D8DC]) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@906314a{/l_tt/na,null,UNAVAILABLE}
[junit4] 2> 1893347 ERROR (TEST-MultiThreadedOCPTest.test-seed#[E3CBA08B85F8D8DC]) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1893348 INFO (TEST-MultiThreadedOCPTest.test-seed#[E3CBA08B85F8D8DC]) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49253 49253
[junit4] 2> 1893371 INFO (Thread-3821) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:49253 49253
[junit4] 2> 1894033 WARN (Thread-3821) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/aliases.json
[junit4] 2> 5 /solr/security.json
[junit4] 2> 5 /solr/configs/conf1
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/clusterprops.json
[junit4] 2> 7 /solr/clusterstate.json
[junit4] 2> 4 /solr/collections/ocptest_shardsplit2/state.json
[junit4] 2> 4 /solr/collections/ocptest1/state.json
[junit4] 2> 4 /solr/collections/collection1/state.json
[junit4] 2> 4 /solr/collections/ocptest3/state.json
[junit4] 2> 4 /solr/collections/ocptest2/state.json
[junit4] 2> 4 /solr/collections/ocptest4/state.json
[junit4] 2> 4 /solr/collections/ocptest_shardsplit/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 7 /solr/live_nodes
[junit4] 2> 7 /solr/collections
[junit4] 2> 2 /solr/overseer/queue
[junit4] 2> 2 /solr/overseer/collection-queue-work
[junit4] 2>
[junit4] 2> NOTE: reproduce with: ant test -Dtestcase=MultiThreadedOCPTest -Dtests.method=test -Dtests.seed=E3CBA08B85F8D8DC -Dtests.slow=true -Dtests.locale=tr -Dtests.timezone=HST -Dtests.asserts=true -Dtests.file.encoding=US-ASCII
[junit4] FAILURE 39.2s J0 | MultiThreadedOCPTest.test <<<
[junit4] > Throwable #1: java.lang.AssertionError: Task 3001 did not complete, final state: FAILED expected same:<COMPLETED> was not:<FAILED>
[junit4] > at __randomizedtesting.SeedInfo.seed([E3CBA08B85F8D8DC:6B9F9F512B04B524]:0)
[junit4] > at org.apache.solr.cloud.MultiThreadedOCPTest.testDeduplicationOfSubmittedTasks(MultiThreadedOCPTest.java:226)
[junit4] > at org.apache.solr.cloud.MultiThreadedOCPTest.test(MultiThreadedOCPTest.java:64)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsFixedStatement.callStatement(BaseDistributedSearchTestCase.java:985)
[junit4] > at org.apache.solr.BaseDistributedSearchTestCase$ShardsRepeatRule$ShardsStatement.evaluate(BaseDistributedSearchTestCase.java:960)
[junit4] > at java.lang.Thread.run(Thread.java:748)
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J0/temp/solr.cloud.MultiThreadedOCPTest_E3CBA08B85F8D8DC-001
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70), sim=RandomSimilarity(queryNorm=true): {}, locale=tr, timezone=HST
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_131 (64-bit)/cpus=3,threads=1,free=96285264,total=502267904
[junit4] 2> NOTE: All tests run in this JVM: [TestHdfsUpdateLog, CdcrUpdateLogTest, DirectoryFactoryTest, NodeMutatorTest, CoreAdminCreateDiscoverTest, TestCSVResponseWriter, TestQuerySenderListener, TestIndexingPerformance, HighlighterConfigTest, TestDefaultStatsCache, HdfsLockFactoryTest, OverriddenZkACLAndCredentialsProvidersTest, TestRawTransformer, TestCursorMarkWithoutUniqueKey, ReplicationFactorTest, IndexBasedSpellCheckerTest, DocValuesTest, TestTlogReplica, TestJsonFacetRefinement, ExplicitHLLTest, TestAtomicUpdateErrorCases, TestUseDocValuesAsStored, TestRandomDVFaceting, PeerSyncTest, TestPayloadScoreQParserPlugin, BooleanFieldTest, TestLRUStatsCache, CreateCollectionCleanupTest, LeaderElectionTest, TestClassNameShortening, TestUtils, TestSSLRandomization, OverseerModifyCollectionTest, PathHierarchyTokenizerFactoryTest, DirectUpdateHandlerOptimizeTest, ClassificationUpdateProcessorFactoryTest, TestSweetSpotSimilarityFactory, TestDocBasedVersionConstraints, SpatialFilterTest, TestIntervalFaceting, TestTestInjection, TestExportWriter, TestOmitPositions, TestMinMaxOnMultiValuedField, NoCacheHeaderTest, TestStressUserVersions, TestSolrConfigHandlerConcurrent, TestJmxIntegration, TestOverriddenPrefixQueryForCustomFieldType, SolrInfoBeanTest, MergeStrategyTest, TestTolerantSearch, SolrCoreTest, TestOnReconnectListenerSupport, V2ApiIntegrationTest, CdcrVersionReplicationTest, TestFieldTypeCollectionResource, DistributedSpellCheckComponentTest, DateMathParserTest, TestReloadAndDeleteDocs, DeleteNodeTest, TestLMDirichletSimilarityFactory, TestDynamicFieldCollectionResource, TriLevelCompositeIdRoutingTest, NumericFieldsTest, HdfsChaosMonkeyNothingIsSafeTest, TestBackupRepositoryFactory, DirectSolrConnectionTest, ConnectionReuseTest, TestReversedWildcardFilterFactory, ReturnFieldsTest, TestFieldSortValues, TestSolrFieldCacheBean, ShardRoutingTest, TestComplexPhraseQParserPlugin, TestSolrCoreProperties, SparseHLLTest, TestCustomStream, TestGraphTermsQParserPlugin, BufferStoreTest, SolrJmxReporterTest, TestManagedStopFilterFactory, TestJsonRequest, BasicAuthStandaloneTest, TestMaxTokenLenTokenizer, SolrTestCaseJ4Test, URLClassifyProcessorTest, TestUpdate, TestXIncludeConfig, TestFreeTextSuggestions, TestLegacyTerms, HdfsDirectoryFactoryTest, AnalysisAfterCoreReloadTest, CurrencyFieldTypeTest, TestBinaryResponseWriter, TestSQLHandlerNonCloud, DocExpirationUpdateProcessorFactoryTest, DistributedFacetPivotWhiteBoxTest, TestExclusionRuleCollectionAccess, PrimUtilsTest, ResponseHeaderTest, TestRuleBasedAuthorizationPlugin, TestSolrCoreSnapshots, SearchHandlerTest, OverseerTest, TestPseudoReturnFields, TestInitParams, SuggestComponentTest, DirectUpdateHandlerTest, DistributedVersionInfoTest, TestBulkSchemaConcurrent, DistribCursorPagingTest, TestHighlightDedupGrouping, TestManagedResource, TestShortCircuitedRequests, TestInPlaceUpdatesStandalone, TestUnifiedSolrHighlighter, TestSolrDeletionPolicy2, OverseerStatusTest, SimpleCollectionCreateDeleteTest, TestSubQueryTransformerCrossCore, FacetPivotSmallTest, LeaderElectionContextKeyTest, TestEmbeddedSolrServerSchemaAPI, MissingSegmentRecoveryTest, PrimitiveFieldTypeTest, MultiTermTest, HdfsCollectionsAPIDistributedZkTest, TestHashPartitioner, CSVRequestHandlerTest, TestGroupingSearch, AutoScalingHandlerTest, AsyncCallRequestStatusResponseTest, UniqFieldsUpdateProcessorFactoryTest, TestFieldCacheSort, SimplePostToolTest, CollectionsAPISolrJTest, TestInitQParser, TestLegacyFieldReuse, SyncSliceTest, SubstringBytesRefFilterTest, ZkCLITest, DistanceFunctionTest, TestSerializedLuceneMatchVersion, TestConfigSetImmutable, VersionInfoTest, DocValuesMissingTest, TestFoldingMultitermQuery, CursorPagingTest, TestStressReorder, TestLegacyFieldCache, RecoveryZkTest, AddBlockUpdateTest, BigEndianAscendingWordSerializerTest, StressHdfsTest, TimeZoneUtilsTest, JvmMetricsTest, DisMaxRequestHandlerTest, TestConfigSetsAPIExclusivity, TestRestoreCore, NotRequiredUniqueKeyTest, SuggesterTest, SolrCloudExampleTest, CdcrBootstrapTest, ConfigSetsAPITest, TestCollectionAPIs, TestBlendedInfixSuggestions, CleanupOldIndexTest, TestRestManager, TestPullReplica, TestCloudRecovery, TestPivotHelperCode, TestSurroundQueryParser, TestPushWriter, SortByFunctionTest, RequestHandlersTest, TestMultiWordSynonyms, XsltUpdateRequestHandlerTest, BasicDistributedZkTest, ChaosMonkeySafeLeaderTest, UnloadDistributedZkTest, OpenCloseCoreStressTest, LeaderElectionIntegrationTest, TestReplicationHandler, TestDistributedSearch, DistributedTermsComponentTest, SolrCmdDistributorTest, BadIndexSchemaTest, TestFunctionQuery, TestBadConfig, TestIndexSearcher, HighlighterTest, SoftAutoCommitTest, SearchHandlerTest, SOLR749Test, UpdateParamsTest, AlternateDirectoryTest, TestSolrIndexConfig, TestQuerySenderNoQuery, CopyFieldTest, ResponseLogComponentTest, TestStressRecovery, OpenExchangeRatesOrgProviderTest, PreAnalyzedFieldTest, TestSystemIdResolver, DateFieldTest, SpellingQueryConverterTest, DOMUtilTest, RAMDirectoryFactoryTest, ClusterStateTest, TestLRUCache, TestDocumentBuilder, ZkNodePropsTest, SliceStateTest, SystemInfoHandlerTest, UUIDFieldTest, CircularListTest, DistributedIntervalFacetingTest, TestCrossCoreJoin, TestSimpleTrackingShardHandler, TestEmbeddedSolrServerConstructors, AliasIntegrationTest, BaseCdcrDistributedZkTest, CdcrReplicationDistributedZkTest, CdcrReplicationHandlerTest, CdcrRequestHandlerTest, ChaosMonkeyNothingIsSafeWithPullReplicasTest, CollectionTooManyReplicasTest, ConcurrentDeleteAndCreateCollectionTest, DeleteInactiveReplicaTest, DeleteShardTest, DeleteStatusTest, DistribJoinFromCollectionTest, ForceLeaderTest, LeaderInitiatedRecoveryOnShardRestartTest, MoveReplicaHDFSTest, MultiThreadedOCPTest]
[junit4] Completed [513/727 (4!)] on J0 in 39.24s, 1 test, 1 failure <<< FAILURES!
[...truncated 44007 lines...]
[JENKINS] Lucene-Solr-7.x-MacOSX (64bit/jdk1.8.0) - Build # 13 -
Unstable!
Posted by Policeman Jenkins Server <je...@thetaphi.de>.
Build: https://jenkins.thetaphi.de/job/Lucene-Solr-7.x-MacOSX/13/
Java: 64bit/jdk1.8.0 -XX:+UseCompressedOops -XX:+UseParallelGC
5 tests failed.
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.addReplicaTest
Error Message:
Could not find collection : addReplicaColl
Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : addReplicaColl
at __randomizedtesting.SeedInfo.seed([72D5A91AC721AA4D:E175FE3C4929E19C]:0)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.addReplicaTest(CollectionsAPIDistributedZkTest.java:606)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCreationAndDeletion
Error Message:
Stack Trace:
java.lang.AssertionError
at __randomizedtesting.SeedInfo.seed([72D5A91AC721AA4D:40D108CACC35F9EC]:0)
at org.junit.Assert.fail(Assert.java:92)
at org.junit.Assert.assertTrue(Assert.java:43)
at org.junit.Assert.assertTrue(Assert.java:54)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCreationAndDeletion(CollectionsAPIDistributedZkTest.java:122)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes
Error Message:
Could not find collection : nodes_used_collection
Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : nodes_used_collection
at __randomizedtesting.SeedInfo.seed([72D5A91AC721AA4D:16957C767CEF225C]:0)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testCoresAreDistributedAcrossNodes(CollectionsAPIDistributedZkTest.java:340)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testSpecificConfigsets
Error Message:
KeeperErrorCode = NoNode for /collections/withconfigset2
Stack Trace:
org.apache.zookeeper.KeeperException$NoNodeException: KeeperErrorCode = NoNode for /collections/withconfigset2
at __randomizedtesting.SeedInfo.seed([72D5A91AC721AA4D:5FABE64030051041]:0)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:111)
at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1212)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:357)
at org.apache.solr.common.cloud.SolrZkClient$7.execute(SolrZkClient.java:354)
at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:60)
at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:354)
at org.apache.solr.cloud.CollectionsAPIDistributedZkTest.testSpecificConfigsets(CollectionsAPIDistributedZkTest.java:368)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
FAILED: org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI
Error Message:
Could not find collection : implicitcoll
Stack Trace:
org.apache.solr.common.SolrException: Could not find collection : implicitcoll
at __randomizedtesting.SeedInfo.seed([72D5A91AC721AA4D:18342771FABB1C35]:0)
at org.apache.solr.common.cloud.ClusterState.getCollection(ClusterState.java:194)
at org.apache.solr.cloud.SolrCloudTestCase.getCollectionState(SolrCloudTestCase.java:247)
at org.apache.solr.cloud.CustomCollectionTest.testCustomCollectionsAPI(CustomCollectionTest.java:68)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at com.carrotsearch.randomizedtesting.RandomizedRunner.invoke(RandomizedRunner.java:1713)
at com.carrotsearch.randomizedtesting.RandomizedRunner$8.evaluate(RandomizedRunner.java:907)
at com.carrotsearch.randomizedtesting.RandomizedRunner$9.evaluate(RandomizedRunner.java:943)
at com.carrotsearch.randomizedtesting.RandomizedRunner$10.evaluate(RandomizedRunner.java:957)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.TestRuleSetupTeardownChained$1.evaluate(TestRuleSetupTeardownChained.java:49)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at org.apache.lucene.util.TestRuleThreadAndTestName$1.evaluate(TestRuleThreadAndTestName.java:48)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at com.carrotsearch.randomizedtesting.ThreadLeakControl.forkTimeoutingTask(ThreadLeakControl.java:817)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$3.evaluate(ThreadLeakControl.java:468)
at com.carrotsearch.randomizedtesting.RandomizedRunner.runSingleTest(RandomizedRunner.java:916)
at com.carrotsearch.randomizedtesting.RandomizedRunner$5.evaluate(RandomizedRunner.java:802)
at com.carrotsearch.randomizedtesting.RandomizedRunner$6.evaluate(RandomizedRunner.java:852)
at com.carrotsearch.randomizedtesting.RandomizedRunner$7.evaluate(RandomizedRunner.java:863)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.SystemPropertiesRestoreRule$1.evaluate(SystemPropertiesRestoreRule.java:57)
at org.apache.lucene.util.AbstractBeforeAfterRule$1.evaluate(AbstractBeforeAfterRule.java:45)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleStoreClassName$1.evaluate(TestRuleStoreClassName.java:41)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.NoShadowingOrOverridesOnMethodsRule$1.evaluate(NoShadowingOrOverridesOnMethodsRule.java:40)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at org.apache.lucene.util.TestRuleAssertionsRequired$1.evaluate(TestRuleAssertionsRequired.java:53)
at org.apache.lucene.util.TestRuleMarkFailure$1.evaluate(TestRuleMarkFailure.java:47)
at org.apache.lucene.util.TestRuleIgnoreAfterMaxFailures$1.evaluate(TestRuleIgnoreAfterMaxFailures.java:64)
at org.apache.lucene.util.TestRuleIgnoreTestSuites$1.evaluate(TestRuleIgnoreTestSuites.java:54)
at com.carrotsearch.randomizedtesting.rules.StatementAdapter.evaluate(StatementAdapter.java:36)
at com.carrotsearch.randomizedtesting.ThreadLeakControl$StatementRunner.run(ThreadLeakControl.java:368)
at java.lang.Thread.run(Thread.java:748)
Build Log:
[...truncated 11460 lines...]
[junit4] Suite: org.apache.solr.cloud.CollectionsAPIDistributedZkTest
[junit4] 2> Creating dataDir: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/init-core-data-001
[junit4] 2> 439502 WARN (SUITE-CollectionsAPIDistributedZkTest-seed#[72D5A91AC721AA4D]-worker) [ ] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=1 numCloses=1
[junit4] 2> 439502 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[72D5A91AC721AA4D]-worker) [ ] o.a.s.SolrTestCaseJ4 Using TrieFields (NUMERIC_POINTS_SYSPROP=false) w/NUMERIC_DOCVALUES_SYSPROP=false
[junit4] 2> 439504 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[72D5A91AC721AA4D]-worker) [ ] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason=, value=NaN, ssl=NaN, clientAuth=NaN) w/ MAC_OS_X supressed clientAuth
[junit4] 2> 439506 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[72D5A91AC721AA4D]-worker) [ ] o.a.s.c.MiniSolrCloudCluster Starting cluster of 4 servers in /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001
[junit4] 2> 439506 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[72D5A91AC721AA4D]-worker) [ ] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER
[junit4] 2> 439506 INFO (Thread-1192) [ ] o.a.s.c.ZkTestServer client port:0.0.0.0/0.0.0.0:0
[junit4] 2> 439506 INFO (Thread-1192) [ ] o.a.s.c.ZkTestServer Starting server
[junit4] 2> 439508 ERROR (Thread-1192) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 439614 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[72D5A91AC721AA4D]-worker) [ ] o.a.s.c.ZkTestServer start zk server on port:60766
[junit4] 2> 439636 INFO (jetty-launcher-901-thread-1) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 439636 INFO (jetty-launcher-901-thread-3) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 439636 INFO (jetty-launcher-901-thread-2) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 439636 INFO (jetty-launcher-901-thread-4) [ ] o.e.j.s.Server jetty-9.3.14.v20161028
[junit4] 2> 439638 INFO (jetty-launcher-901-thread-1) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@345d6a2c{/solr,null,AVAILABLE}
[junit4] 2> 439639 INFO (jetty-launcher-901-thread-1) [ ] o.e.j.s.AbstractConnector Started ServerConnector@247a4ade{HTTP/1.1,[http/1.1]}{127.0.0.1:60768}
[junit4] 2> 439639 INFO (jetty-launcher-901-thread-1) [ ] o.e.j.s.Server Started @443183ms
[junit4] 2> 439639 INFO (jetty-launcher-901-thread-1) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60768}
[junit4] 2> 439639 ERROR (jetty-launcher-901-thread-1) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 439639 INFO (jetty-launcher-901-thread-1) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 439639 INFO (jetty-launcher-901-thread-1) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 439639 INFO (jetty-launcher-901-thread-4) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@4c7e076d{/solr,null,AVAILABLE}
[junit4] 2> 439639 INFO (jetty-launcher-901-thread-1) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 439640 INFO (jetty-launcher-901-thread-1) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T11:22:02.530Z
[junit4] 2> 439640 INFO (jetty-launcher-901-thread-2) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@17376283{/solr,null,AVAILABLE}
[junit4] 2> 439640 INFO (jetty-launcher-901-thread-2) [ ] o.e.j.s.AbstractConnector Started ServerConnector@20f7f15d{HTTP/1.1,[http/1.1]}{127.0.0.1:60770}
[junit4] 2> 439640 INFO (jetty-launcher-901-thread-2) [ ] o.e.j.s.Server Started @443184ms
[junit4] 2> 439640 INFO (jetty-launcher-901-thread-2) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60770}
[junit4] 2> 439641 ERROR (jetty-launcher-901-thread-2) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 439641 INFO (jetty-launcher-901-thread-2) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 439641 INFO (jetty-launcher-901-thread-2) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 439641 INFO (jetty-launcher-901-thread-2) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 439641 INFO (jetty-launcher-901-thread-2) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T11:22:02.531Z
[junit4] 2> 439641 INFO (jetty-launcher-901-thread-3) [ ] o.e.j.s.h.ContextHandler Started o.e.j.s.ServletContextHandler@36b766e6{/solr,null,AVAILABLE}
[junit4] 2> 439642 INFO (jetty-launcher-901-thread-4) [ ] o.e.j.s.AbstractConnector Started ServerConnector@7c15497a{HTTP/1.1,[http/1.1]}{127.0.0.1:60769}
[junit4] 2> 439642 INFO (jetty-launcher-901-thread-4) [ ] o.e.j.s.Server Started @443186ms
[junit4] 2> 439642 INFO (jetty-launcher-901-thread-4) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60769}
[junit4] 2> 439642 ERROR (jetty-launcher-901-thread-4) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 439642 INFO (jetty-launcher-901-thread-3) [ ] o.e.j.s.AbstractConnector Started ServerConnector@41f02c19{HTTP/1.1,[http/1.1]}{127.0.0.1:60771}
[junit4] 2> 439642 INFO (jetty-launcher-901-thread-3) [ ] o.e.j.s.Server Started @443186ms
[junit4] 2> 439642 INFO (jetty-launcher-901-thread-3) [ ] o.a.s.c.s.e.JettySolrRunner Jetty properties: {hostContext=/solr, hostPort=60771}
[junit4] 2> 439642 ERROR (jetty-launcher-901-thread-3) [ ] o.a.s.s.StartupLoggingUtils Missing Java Option solr.log.dir. Logging may be missing or incomplete.
[junit4] 2> 439642 INFO (jetty-launcher-901-thread-4) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 439643 INFO (jetty-launcher-901-thread-4) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 439643 INFO (jetty-launcher-901-thread-4) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 439643 INFO (jetty-launcher-901-thread-4) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T11:22:02.533Z
[junit4] 2> 439643 INFO (jetty-launcher-901-thread-3) [ ] o.a.s.s.SolrDispatchFilter ___ _ Welcome to Apache Solr™ version 7.1.0
[junit4] 2> 439644 INFO (jetty-launcher-901-thread-3) [ ] o.a.s.s.SolrDispatchFilter / __| ___| |_ _ Starting in cloud mode on port null
[junit4] 2> 439644 INFO (jetty-launcher-901-thread-3) [ ] o.a.s.s.SolrDispatchFilter \__ \/ _ \ | '_| Install dir: null, Default config dir: null
[junit4] 2> 439644 INFO (jetty-launcher-901-thread-3) [ ] o.a.s.s.SolrDispatchFilter |___/\___/_|_| Start time: 2017-07-07T11:22:02.534Z
[junit4] 2> 439646 INFO (jetty-launcher-901-thread-1) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 439646 INFO (jetty-launcher-901-thread-2) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 439647 INFO (jetty-launcher-901-thread-4) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 439649 INFO (jetty-launcher-901-thread-3) [ ] o.a.s.s.SolrDispatchFilter solr.xml found in ZooKeeper. Loading...
[junit4] 2> 439657 INFO (jetty-launcher-901-thread-1) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60766/solr
[junit4] 2> 439657 INFO (jetty-launcher-901-thread-4) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60766/solr
[junit4] 2> 439658 INFO (jetty-launcher-901-thread-2) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60766/solr
[junit4] 2> 439665 INFO (jetty-launcher-901-thread-3) [ ] o.a.s.c.ZkContainer Zookeeper client=127.0.0.1:60766/solr
[junit4] 2> 439841 INFO (jetty-launcher-901-thread-2) [n:127.0.0.1:60770_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 439842 INFO (jetty-launcher-901-thread-4) [n:127.0.0.1:60769_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 439842 INFO (jetty-launcher-901-thread-2) [n:127.0.0.1:60770_solr ] o.a.s.c.OverseerElectionContext I am going to be the leader 127.0.0.1:60770_solr
[junit4] 2> 439843 INFO (jetty-launcher-901-thread-4) [n:127.0.0.1:60769_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60769_solr
[junit4] 2> 439844 INFO (jetty-launcher-901-thread-2) [n:127.0.0.1:60770_solr ] o.a.s.c.Overseer Overseer (id=98266416571875338-127.0.0.1:60770_solr-n_0000000000) starting
[junit4] 2> 439846 INFO (zkCallback-922-thread-1-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 439846 INFO (zkCallback-921-thread-1-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1)
[junit4] 2> 439861 INFO (jetty-launcher-901-thread-2) [n:127.0.0.1:60770_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60770_solr
[junit4] 2> 439865 INFO (zkCallback-922-thread-1-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 439865 INFO (zkCallback-921-thread-1-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (2)
[junit4] 2> 439898 INFO (jetty-launcher-901-thread-3) [n:127.0.0.1:60771_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 439899 INFO (jetty-launcher-901-thread-1) [n:127.0.0.1:60768_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (2)
[junit4] 2> 439902 INFO (jetty-launcher-901-thread-3) [n:127.0.0.1:60771_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 439902 INFO (jetty-launcher-901-thread-1) [n:127.0.0.1:60768_solr ] o.a.s.c.Overseer Overseer (id=null) closing
[junit4] 2> 439904 INFO (jetty-launcher-901-thread-3) [n:127.0.0.1:60771_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60771_solr
[junit4] 2> 439905 INFO (jetty-launcher-901-thread-1) [n:127.0.0.1:60768_solr ] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/127.0.0.1:60768_solr
[junit4] 2> 439917 INFO (zkCallback-923-thread-1-processing-n:127.0.0.1:60771_solr) [n:127.0.0.1:60771_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 439917 INFO (zkCallback-918-thread-1-processing-n:127.0.0.1:60768_solr) [n:127.0.0.1:60768_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 439922 INFO (zkCallback-922-thread-1-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 439922 INFO (zkCallback-921-thread-1-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (2) -> (3)
[junit4] 2> 439924 INFO (zkCallback-918-thread-1-processing-n:127.0.0.1:60768_solr) [n:127.0.0.1:60768_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 439933 INFO (zkCallback-923-thread-1-processing-n:127.0.0.1:60771_solr) [n:127.0.0.1:60771_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 439933 INFO (zkCallback-921-thread-1-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 439933 INFO (zkCallback-922-thread-1-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (4)
[junit4] 2> 439993 INFO (jetty-launcher-901-thread-4) [n:127.0.0.1:60769_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 439998 INFO (jetty-launcher-901-thread-4) [n:127.0.0.1:60769_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 439998 INFO (jetty-launcher-901-thread-4) [n:127.0.0.1:60769_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 440000 INFO (jetty-launcher-901-thread-4) [n:127.0.0.1:60769_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node4
[junit4] 2> 440004 INFO (jetty-launcher-901-thread-1) [n:127.0.0.1:60768_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 440012 INFO (jetty-launcher-901-thread-3) [n:127.0.0.1:60771_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 440014 INFO (jetty-launcher-901-thread-2) [n:127.0.0.1:60770_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.node' (registry 'solr.node') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 440017 INFO (jetty-launcher-901-thread-1) [n:127.0.0.1:60768_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 440017 INFO (jetty-launcher-901-thread-1) [n:127.0.0.1:60768_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 440020 INFO (jetty-launcher-901-thread-1) [n:127.0.0.1:60768_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node1
[junit4] 2> 440024 INFO (jetty-launcher-901-thread-3) [n:127.0.0.1:60771_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 440024 INFO (jetty-launcher-901-thread-3) [n:127.0.0.1:60771_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 440025 INFO (jetty-launcher-901-thread-2) [n:127.0.0.1:60770_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jvm' (registry 'solr.jvm') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 440025 INFO (jetty-launcher-901-thread-2) [n:127.0.0.1:60770_solr ] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.jetty' (registry 'solr.jetty') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 440026 INFO (jetty-launcher-901-thread-3) [n:127.0.0.1:60771_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node3
[junit4] 2> 440027 INFO (jetty-launcher-901-thread-2) [n:127.0.0.1:60770_solr ] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node2
[junit4] 2> 440092 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[72D5A91AC721AA4D]-worker) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 440094 INFO (SUITE-CollectionsAPIDistributedZkTest-seed#[72D5A91AC721AA4D]-worker) [ ] o.a.s.c.s.i.ZkClientClusterStateProvider Cluster at 127.0.0.1:60766/solr ready
[junit4] 2> 440119 INFO (TEST-CollectionsAPIDistributedZkTest.testCollectionReload-seed#[72D5A91AC721AA4D]) [ ] o.a.s.SolrTestCaseJ4 ###Starting testCollectionReload
[junit4] 2> 440120 INFO (TEST-CollectionsAPIDistributedZkTest.testCollectionReload-seed#[72D5A91AC721AA4D]) [ ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (4)
[junit4] 2> 440124 INFO (qtp814464609-5199) [n:127.0.0.1:60771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :create with params replicationFactor=2&collection.configName=conf&name=reloaded_collection&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 440126 INFO (OverseerThreadFactory-2575-thread-1-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.CreateCollectionCmd Create collection reloaded_collection
[junit4] 2> 440239 INFO (OverseerStateUpdate-98266416571875338-127.0.0.1:60770_solr-n_0000000000) [n:127.0.0.1:60770_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"reloaded_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"reloaded_collection_shard1_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60768/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 440241 INFO (OverseerStateUpdate-98266416571875338-127.0.0.1:60770_solr-n_0000000000) [n:127.0.0.1:60770_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"reloaded_collection",
[junit4] 2> "shard":"shard1",
[junit4] 2> "core":"reloaded_collection_shard1_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60770/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 440243 INFO (OverseerStateUpdate-98266416571875338-127.0.0.1:60770_solr-n_0000000000) [n:127.0.0.1:60770_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"reloaded_collection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"reloaded_collection_shard2_replica_n1",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60771/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 440244 INFO (OverseerStateUpdate-98266416571875338-127.0.0.1:60770_solr-n_0000000000) [n:127.0.0.1:60770_solr ] o.a.s.c.o.SliceMutator createReplica() {
[junit4] 2> "operation":"ADDREPLICA",
[junit4] 2> "collection":"reloaded_collection",
[junit4] 2> "shard":"shard2",
[junit4] 2> "core":"reloaded_collection_shard2_replica_n2",
[junit4] 2> "state":"down",
[junit4] 2> "base_url":"http://127.0.0.1:60769/solr",
[junit4] 2> "type":"NRT"}
[junit4] 2> 440455 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr ] o.a.s.u.TestInjection Inject random core creation delay of 1s
[junit4] 2> 440456 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr ] o.a.s.u.TestInjection Inject random core creation delay of 1s
[junit4] 2> 440456 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr ] o.a.s.u.TestInjection Inject random core creation delay of 1s
[junit4] 2> 440458 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr ] o.a.s.u.TestInjection Inject random core creation delay of 1s
[junit4] 2> 441456 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=reloaded_collection_shard2_replica_n1&action=CREATE&numShards=2&collection=reloaded_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 441456 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=reloaded_collection_shard2_replica_n2&action=CREATE&numShards=2&collection=reloaded_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 441457 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 441457 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 441459 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node1&collection.configName=conf&newCollection=true&name=reloaded_collection_shard1_replica_n1&action=CREATE&numShards=2&collection=reloaded_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 441459 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr ] o.a.s.h.a.CoreAdminOperation core create command qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=reloaded_collection_shard1_replica_n2&action=CREATE&numShards=2&collection=reloaded_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT
[junit4] 2> 441460 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 441460 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr ] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient cache for 2147483647 transient cores
[junit4] 2> 441594 INFO (zkCallback-923-thread-1-processing-n:127.0.0.1:60771_solr) [n:127.0.0.1:60771_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 441594 INFO (zkCallback-921-thread-1-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 441594 INFO (zkCallback-922-thread-1-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 441594 INFO (zkCallback-918-thread-1-processing-n:127.0.0.1:60768_solr) [n:127.0.0.1:60768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 441594 INFO (zkCallback-923-thread-2-processing-n:127.0.0.1:60771_solr) [n:127.0.0.1:60771_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 441595 INFO (zkCallback-922-thread-2-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 441596 INFO (zkCallback-918-thread-2-processing-n:127.0.0.1:60768_solr) [n:127.0.0.1:60768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 441596 INFO (zkCallback-921-thread-2-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442488 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 442488 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 442488 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 442492 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.SolrConfig Using Lucene MatchVersion: 7.1.0
[junit4] 2> 442493 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.s.IndexSchema [reloaded_collection_shard1_replica_n1] Schema name=minimal
[junit4] 2> 442493 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.s.IndexSchema [reloaded_collection_shard2_replica_n2] Schema name=minimal
[junit4] 2> 442495 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.s.IndexSchema [reloaded_collection_shard2_replica_n1] Schema name=minimal
[junit4] 2> 442496 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 442496 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 442496 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'reloaded_collection_shard2_replica_n2' using configuration from collection reloaded_collection, trusted=true
[junit4] 2> 442496 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'reloaded_collection_shard1_replica_n1' using configuration from collection reloaded_collection, trusted=true
[junit4] 2> 442496 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 442497 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.c.CoreContainer Creating SolrCore 'reloaded_collection_shard2_replica_n1' using configuration from collection reloaded_collection, trusted=true
[junit4] 2> 442497 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.reloaded_collection.shard1.replica_n1' (registry 'solr.core.reloaded_collection.shard1.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 442497 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.reloaded_collection.shard2.replica_n2' (registry 'solr.core.reloaded_collection.shard2.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 442497 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.reloaded_collection.shard2.replica_n1' (registry 'solr.core.reloaded_collection.shard2.replica_n1') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 442497 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 442497 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 442497 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.c.SolrCore [[reloaded_collection_shard1_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node1/reloaded_collection_shard1_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node1/reloaded_collection_shard1_replica_n1/data/]
[junit4] 2> 442497 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.SolrCore [[reloaded_collection_shard2_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node4/reloaded_collection_shard2_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node4/reloaded_collection_shard2_replica_n2/data/]
[junit4] 2> 442497 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 442497 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.c.SolrCore [[reloaded_collection_shard2_replica_n1] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node3/reloaded_collection_shard2_replica_n1], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node3/reloaded_collection_shard2_replica_n1/data/]
[junit4] 2> 442500 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.s.IndexSchema [reloaded_collection_shard1_replica_n2] Schema name=minimal
[junit4] 2> 442501 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.s.IndexSchema Loaded schema minimal/1.1 with uniqueid field id
[junit4] 2> 442501 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.CoreContainer Creating SolrCore 'reloaded_collection_shard1_replica_n2' using configuration from collection reloaded_collection, trusted=true
[junit4] 2> 442501 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.m.r.SolrJmxReporter JMX monitoring for 'solr.core.reloaded_collection.shard1.replica_n2' (registry 'solr.core.reloaded_collection.shard1.replica_n2') enabled at server: com.sun.jmx.mbeanserver.JmxMBeanServer@4b4cb90b
[junit4] 2> 442501 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.SolrCore solr.RecoveryStrategy.Builder
[junit4] 2> 442502 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.SolrCore [[reloaded_collection_shard1_replica_n2] ] Opening new SolrCore at [/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node2/reloaded_collection_shard1_replica_n2], dataDir=[/Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CollectionsAPIDistributedZkTest_72D5A91AC721AA4D-001/tempDir-001/node2/reloaded_collection_shard1_replica_n2/data/]
[junit4] 2> 442568 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 442568 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 442568 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 442568 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 442569 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 442569 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 442569 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 442569 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 442569 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 442569 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 442570 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.u.UpdateHandler Using UpdateLog implementation: org.apache.solr.update.UpdateLog
[junit4] 2> 442570 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 442570 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 442570 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.u.UpdateLog Initializing UpdateLog: dataDir=null defaultSyncLevel=FLUSH numRecordsToKeep=100 maxNumLogsToKeep=10 numVersionBuckets=65536
[junit4] 2> 442572 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@2216a595[reloaded_collection_shard2_replica_n2] main]
[junit4] 2> 442572 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.u.CommitTracker Hard AutoCommit: disabled
[junit4] 2> 442572 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.u.CommitTracker Soft AutoCommit: disabled
[junit4] 2> 442572 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@2925f30a[reloaded_collection_shard1_replica_n1] main]
[junit4] 2> 442573 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.s.SolrIndexSearcher Opening [Searcher@5aa70d86[reloaded_collection_shard1_replica_n2] main]
[junit4] 2> 442573 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 442573 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 442574 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 442574 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 442574 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 442574 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572262668364939264
[junit4] 2> 442574 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 442574 INFO (searcherExecutor-2584-thread-1-processing-n:127.0.0.1:60769_solr x:reloaded_collection_shard2_replica_n2 s:shard2 c:reloaded_collection r:core_node4) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.SolrCore [reloaded_collection_shard2_replica_n2] Registered new searcher Searcher@2216a595[reloaded_collection_shard2_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 442575 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 442575 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 442575 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572262668365987840
[junit4] 2> 442575 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 442575 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572262668365987840
[junit4] 2> 442575 INFO (searcherExecutor-2585-thread-1-processing-n:127.0.0.1:60768_solr x:reloaded_collection_shard1_replica_n1 s:shard1 c:reloaded_collection r:core_node1) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.c.SolrCore [reloaded_collection_shard1_replica_n1] Registered new searcher Searcher@2925f30a[reloaded_collection_shard1_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 442576 INFO (searcherExecutor-2587-thread-1-processing-n:127.0.0.1:60770_solr x:reloaded_collection_shard1_replica_n2 s:shard1 c:reloaded_collection r:core_node2) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.SolrCore [reloaded_collection_shard1_replica_n2] Registered new searcher Searcher@5aa70d86[reloaded_collection_shard1_replica_n2] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 442576 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.s.SolrIndexSearcher Opening [Searcher@3bc74c2[reloaded_collection_shard2_replica_n1] main]
[junit4] 2> 442578 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.r.ManagedResourceStorage Configured ZooKeeperStorageIO with znodeBase: /configs/conf
[junit4] 2> 442578 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.r.ManagedResourceStorage Loaded null at path _rest_managed.json using ZooKeeperStorageIO:path=/configs/conf
[junit4] 2> 442579 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.h.ReplicationHandler Commits will be reserved for 10000
[junit4] 2> 442579 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.u.UpdateLog Could not find max version in index or recent updates, using new clock 1572262668370182144
[junit4] 2> 442579 INFO (searcherExecutor-2586-thread-1-processing-n:127.0.0.1:60771_solr x:reloaded_collection_shard2_replica_n1 s:shard2 c:reloaded_collection r:core_node3) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.c.SolrCore [reloaded_collection_shard2_replica_n1] Registered new searcher Searcher@3bc74c2[reloaded_collection_shard2_replica_n1] main{ExitableDirectoryReader(UninvertingDirectoryReader())}
[junit4] 2> 442583 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 442583 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 442583 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60770/solr/reloaded_collection_shard1_replica_n2/
[junit4] 2> 442583 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Enough replicas found to continue.
[junit4] 2> 442583 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I may be the new leader - try and sync
[junit4] 2> 442583 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.SyncStrategy Sync replicas to http://127.0.0.1:60769/solr/reloaded_collection_shard2_replica_n2/
[junit4] 2> 442583 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=reloaded_collection_shard1_replica_n2 url=http://127.0.0.1:60770/solr START replicas=[http://127.0.0.1:60768/solr/reloaded_collection_shard1_replica_n1/] nUpdates=100
[junit4] 2> 442583 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.u.PeerSync PeerSync: core=reloaded_collection_shard2_replica_n2 url=http://127.0.0.1:60769/solr START replicas=[http://127.0.0.1:60771/solr/reloaded_collection_shard2_replica_n1/] nUpdates=100
[junit4] 2> 442583 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.u.PeerSync PeerSync: core=reloaded_collection_shard1_replica_n2 url=http://127.0.0.1:60770/solr DONE. We have no versions. sync failed.
[junit4] 2> 442584 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.u.PeerSync PeerSync: core=reloaded_collection_shard2_replica_n2 url=http://127.0.0.1:60769/solr DONE. We have no versions. sync failed.
[junit4] 2> 442585 INFO (qtp814464609-5213) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.c.S.Request [reloaded_collection_shard2_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 442585 INFO (qtp1319977869-5185) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.c.S.Request [reloaded_collection_shard1_replica_n1] webapp=/solr path=/get params={distrib=false&qt=/get&fingerprint=false&getVersions=100&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 442586 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 442586 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 442586 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 442586 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.SyncStrategy Leader's attempt to sync with shard failed, moving to the next candidate
[junit4] 2> 442586 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext We failed sync, but we have no versions - we can't sync in that case - we were active before, so become leader anyway
[junit4] 2> 442586 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext Found all replicas participating in election, clear LIR
[junit4] 2> 442590 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60769/solr/reloaded_collection_shard2_replica_n2/ shard2
[junit4] 2> 442591 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.ShardLeaderElectionContext I am the new leader: http://127.0.0.1:60770/solr/reloaded_collection_shard1_replica_n2/ shard1
[junit4] 2> 442705 INFO (zkCallback-918-thread-2-processing-n:127.0.0.1:60768_solr) [n:127.0.0.1:60768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442705 INFO (zkCallback-921-thread-2-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442706 INFO (zkCallback-923-thread-2-processing-n:127.0.0.1:60771_solr) [n:127.0.0.1:60771_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442706 INFO (zkCallback-921-thread-1-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442706 INFO (zkCallback-923-thread-1-processing-n:127.0.0.1:60771_solr) [n:127.0.0.1:60771_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442706 INFO (zkCallback-922-thread-1-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442706 INFO (zkCallback-922-thread-2-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442705 INFO (zkCallback-918-thread-1-processing-n:127.0.0.1:60768_solr) [n:127.0.0.1:60768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442764 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 442764 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.c.ZkController I am the leader, no recovery necessary
[junit4] 2> 442769 INFO (qtp1257055715-5194) [n:127.0.0.1:60769_solr c:reloaded_collection s:shard2 r:core_node4 x:reloaded_collection_shard2_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node4&collection.configName=conf&newCollection=true&name=reloaded_collection_shard2_replica_n2&action=CREATE&numShards=2&collection=reloaded_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2313
[junit4] 2> 442769 INFO (qtp1731000732-5193) [n:127.0.0.1:60770_solr c:reloaded_collection s:shard1 r:core_node2 x:reloaded_collection_shard1_replica_n2] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node2&collection.configName=conf&newCollection=true&name=reloaded_collection_shard1_replica_n2&action=CREATE&numShards=2&collection=reloaded_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=2313
[junit4] 2> 442879 INFO (zkCallback-921-thread-1-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442879 INFO (zkCallback-918-thread-1-processing-n:127.0.0.1:60768_solr) [n:127.0.0.1:60768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442879 INFO (zkCallback-923-thread-1-processing-n:127.0.0.1:60771_solr) [n:127.0.0.1:60771_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442880 INFO (zkCallback-923-thread-2-processing-n:127.0.0.1:60771_solr) [n:127.0.0.1:60771_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442880 INFO (zkCallback-922-thread-2-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442880 INFO (zkCallback-922-thread-1-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442879 INFO (zkCallback-918-thread-2-processing-n:127.0.0.1:60768_solr) [n:127.0.0.1:60768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 442879 INFO (zkCallback-921-thread-2-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 443588 INFO (qtp1319977869-5182) [n:127.0.0.1:60768_solr c:reloaded_collection s:shard1 r:core_node1 x:reloaded_collection_shard1_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node1&collection.configName=conf&newCollection=true&name=reloaded_collection_shard1_replica_n1&action=CREATE&numShards=2&collection=reloaded_collection&shard=shard1&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3129
[junit4] 2> 443588 INFO (qtp814464609-5211) [n:127.0.0.1:60771_solr c:reloaded_collection s:shard2 r:core_node3 x:reloaded_collection_shard2_replica_n1] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&coreNodeName=core_node3&collection.configName=conf&newCollection=true&name=reloaded_collection_shard2_replica_n1&action=CREATE&numShards=2&collection=reloaded_collection&shard=shard2&wt=javabin&version=2&replicaType=NRT} status=0 QTime=3138
[junit4] 2> 443594 INFO (qtp814464609-5199) [n:127.0.0.1:60771_solr ] o.a.s.h.a.CollectionsHandler Wait for new collection to be active for at most 30 seconds. Check all shard replicas
[junit4] 2> 443699 INFO (zkCallback-923-thread-2-processing-n:127.0.0.1:60771_solr) [n:127.0.0.1:60771_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 443699 INFO (zkCallback-918-thread-1-processing-n:127.0.0.1:60768_solr) [n:127.0.0.1:60768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 443699 INFO (zkCallback-923-thread-1-processing-n:127.0.0.1:60771_solr) [n:127.0.0.1:60771_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 443699 INFO (zkCallback-921-thread-2-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 443699 INFO (zkCallback-921-thread-1-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 443699 INFO (zkCallback-922-thread-1-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 443699 INFO (zkCallback-922-thread-2-processing-n:127.0.0.1:60769_solr) [n:127.0.0.1:60769_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 443699 INFO (zkCallback-918-thread-2-processing-n:127.0.0.1:60768_solr) [n:127.0.0.1:60768_solr ] o.a.s.c.c.ZkStateReader A cluster state change: [WatchedEvent state:SyncConnected type:NodeDataChanged path:/collections/reloaded_collection/state.json] for collection [reloaded_collection] has occurred - updating... (live nodes size: [4])
[junit4] 2> 444147 INFO (OverseerCollectionConfigSetProcessor-98266416571875338-127.0.0.1:60770_solr-n_0000000000) [n:127.0.0.1:60770_solr ] o.a.s.c.OverseerTaskQueue Response ZK path: /overseer/collection-queue-work/qnr-0000000000 doesn't exist. Requestor may have disconnected from ZooKeeper
[junit4] 2> 444595 INFO (qtp814464609-5199) [n:127.0.0.1:60771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={replicationFactor=2&collection.configName=conf&name=reloaded_collection&nrtReplicas=2&action=CREATE&numShards=2&wt=javabin&version=2} status=0 QTime=4470
[junit4] 2> 444598 INFO (qtp1319977869-5188) [n:127.0.0.1:60768_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=false&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444601 INFO (qtp1731000732-5204) [n:127.0.0.1:60770_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=false&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444602 INFO (qtp814464609-5186) [n:127.0.0.1:60771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=false&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444604 INFO (qtp1257055715-5197) [n:127.0.0.1:60769_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=false&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444605 INFO (qtp814464609-5202) [n:127.0.0.1:60771_solr ] o.a.s.h.a.CollectionsHandler Invoked Collection Action :reload with params async=549a20d8-a7d8-4381-a98d-fe2ba8b019ab&name=reloaded_collection&action=RELOAD&wt=javabin&version=2 and sendToOCPQueue=true
[junit4] 2> 444607 INFO (qtp814464609-5202) [n:127.0.0.1:60771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/collections params={async=549a20d8-a7d8-4381-a98d-fe2ba8b019ab&name=reloaded_collection&action=RELOAD&wt=javabin&version=2} status=0 QTime=2
[junit4] 2> 444610 INFO (qtp1319977869-5183) [n:127.0.0.1:60768_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=false&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444610 INFO (OverseerThreadFactory-2575-thread-2-processing-n:127.0.0.1:60770_solr) [n:127.0.0.1:60770_solr ] o.a.s.c.OverseerCollectionMessageHandler Executing Collection Cmd : action=RELOAD
[junit4] 2> 444611 INFO (qtp1731000732-5209) [n:127.0.0.1:60770_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=false&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444613 INFO (qtp1319977869-5185) [n:127.0.0.1:60768_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={core=reloaded_collection_shard1_replica_n1&async=549a20d8-a7d8-4381-a98d-fe2ba8b019ab3538977194597540&qt=/admin/cores&action=RELOAD&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444614 INFO (qtp814464609-5213) [n:127.0.0.1:60771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=false&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444615 INFO (qtp1731000732-5184) [n:127.0.0.1:60770_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={core=reloaded_collection_shard1_replica_n2&async=549a20d8-a7d8-4381-a98d-fe2ba8b019ab3538977194646563&qt=/admin/cores&action=RELOAD&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444617 INFO (qtp814464609-5213) [n:127.0.0.1:60771_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={core=reloaded_collection_shard2_replica_n1&async=549a20d8-a7d8-4381-a98d-fe2ba8b019ab3538977194673242&qt=/admin/cores&action=RELOAD&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444618 INFO (qtp1257055715-5201) [n:127.0.0.1:60769_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={action=STATUS&indexInfo=false&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444619 INFO (qtp1257055715-5201) [n:127.0.0.1:60769_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={core=reloaded_collection_shard2_replica_n2&async=549a20d8-a7d8-4381-a98d-fe2ba8b019ab3538977194696180&qt=/admin/cores&action=RELOAD&wt=javabin&version=2} status=0 QTime=0
[junit4] 2> 444621 INFO (qtp1731000732-5200) [n:127.0.0.1:60770_solr ] o.a.s.h.a.CoreAdminOperation Checking request status for : 549a20d8-a7d8-4381-a98d-fe2ba8b019ab3538977194646563
[junit4] 2> 444622 INFO (qtp1731000732-5200) [n:127.0.0.1:60770_solr ] o.a.s.s.HttpSolrCall [admin] webapp=null path=/admin/cores params={qt=/admin/cores&requestid=549a20d8-a7d8-4381-a98d-fe2ba8b019ab3538977194646563&action=REQUESTSTATUS&wt=javabin&version=2} status=0 QTime=1
[junit4] 2> 4
[...truncated too long message...]
67-thread-1-processing-n:127.0.0.1:62782_solr) [n:127.0.0.1:62782_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1118574 INFO (zkCallback-1463-thread-3-processing-n:127.0.0.1:62779_solr) [n:127.0.0.1:62779_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1118574 INFO (zkCallback-1468-thread-1-processing-n:127.0.0.1:62784_solr) [n:127.0.0.1:62784_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (4) -> (3)
[junit4] 2> 1118602 INFO (jetty-closer-1447-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1118602 INFO (jetty-closer-1447-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1118607 INFO (jetty-closer-1447-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm, tag=null
[junit4] 2> 1118622 INFO (jetty-closer-1447-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1118622 INFO (jetty-closer-1447-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1118622 INFO (jetty-closer-1447-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty, tag=null
[junit4] 2> 1118624 INFO (jetty-closer-1447-thread-2) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1118624 INFO (jetty-closer-1447-thread-3) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1118624 INFO (jetty-closer-1447-thread-4) [ ] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.cluster, tag=null
[junit4] 2> 1118628 INFO (jetty-closer-1447-thread-3) [ ] o.a.s.c.Overseer Overseer (id=98266457833013259-127.0.0.1:62782_solr-n_0000000000) closing
[junit4] 2> 1118628 INFO (OverseerStateUpdate-98266457833013259-127.0.0.1:62782_solr-n_0000000000) [n:127.0.0.1:62782_solr ] o.a.s.c.Overseer Overseer Loop exiting : 127.0.0.1:62782_solr
[junit4] 2> 1118629 WARN (zkCallback-1468-thread-1-processing-n:127.0.0.1:62784_solr) [n:127.0.0.1:62784_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1118630 INFO (jetty-closer-1447-thread-4) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@d844a11{/solr,null,UNAVAILABLE}
[junit4] 2> 1118631 INFO (zkCallback-1463-thread-2-processing-n:127.0.0.1:62779_solr) [n:127.0.0.1:62779_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1118632 INFO (zkCallback-1467-thread-3-processing-n:127.0.0.1:62782_solr) [n:127.0.0.1:62782_solr ] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (3) -> (2)
[junit4] 2> 1118632 WARN (zkCallback-1463-thread-2-processing-n:127.0.0.1:62779_solr) [n:127.0.0.1:62779_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1120142 WARN (zkCallback-1467-thread-3-processing-n:127.0.0.1:62782_solr) [n:127.0.0.1:62782_solr ] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: [KeeperErrorCode = Session expired for /live_nodes]
[junit4] 2> 1120142 INFO (jetty-closer-1447-thread-3) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@15388e27{/solr,null,UNAVAILABLE}
[junit4] 2> 1120142 INFO (jetty-closer-1447-thread-2) [ ] o.e.j.s.h.ContextHandler Stopped o.e.j.s.ServletContextHandler@50583201{/solr,null,UNAVAILABLE}
[junit4] 2> 1120143 ERROR (SUITE-CustomCollectionTest-seed#[72D5A91AC721AA4D]-worker) [ ] o.a.z.s.ZooKeeperServer ZKShutdownHandler is not registered, so ZooKeeper server won't take any action on ERROR or SHUTDOWN server state changes
[junit4] 2> 1120158 INFO (SUITE-CustomCollectionTest-seed#[72D5A91AC721AA4D]-worker) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:62777 62777
[junit4] 2> 1120175 INFO (Thread-2158) [ ] o.a.s.c.ZkTestServer connecting to 127.0.0.1:62777 62777
[junit4] 2> 1120409 WARN (Thread-2158) [ ] o.a.s.c.ZkTestServer Watch limit violations:
[junit4] 2> Maximum concurrent create/delete watches above limit:
[junit4] 2>
[junit4] 2> 11 /solr/configs/conf
[junit4] 2> 9 /solr/clusterprops.json
[junit4] 2> 9 /solr/aliases.json
[junit4] 2> 4 /solr/security.json
[junit4] 2> 4 /solr/collections/implicitcoll/state.json
[junit4] 2>
[junit4] 2> Maximum concurrent data watches above limit:
[junit4] 2>
[junit4] 2> 36 /solr/collections/withShardField/state.json
[junit4] 2> 28 /solr/collections/routeFieldColl/state.json
[junit4] 2> 25 /solr/collections/testCreateShardRepFactor/state.json
[junit4] 2> 12 /solr/collections/implicitcoll/state.json
[junit4] 2> 9 /solr/clusterstate.json
[junit4] 2> 2 /solr/collections/withShardField/leader_elect/d/election/98266457833013259-core_node14-n_0000000000
[junit4] 2> 2 /solr/overseer_elect/election/98266457833013260-127.0.0.1:62784_solr-n_0000000001
[junit4] 2> 2 /solr/collections/withShardField/leader_elect/c/election/98266457833013256-core_node12-n_0000000000
[junit4] 2> 2 /solr/collections/withShardField/leader_elect/b/election/98266457833013259-core_node6-n_0000000000
[junit4] 2>
[junit4] 2> Maximum concurrent children watches above limit:
[junit4] 2>
[junit4] 2> 32 /solr/collections
[junit4] 2> 9 /solr/live_nodes
[junit4] 2>
[junit4] 2> NOTE: leaving temporary files on disk at: /Users/jenkins/workspace/Lucene-Solr-7.x-MacOSX/solr/build/solr-core/test/J1/temp/solr.cloud.CustomCollectionTest_72D5A91AC721AA4D-001
[junit4] 2> Jul 07, 2017 11:33:23 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks
[junit4] 2> WARNING: Will linger awaiting termination of 1 leaked thread(s).
[junit4] 2> NOTE: test params are: codec=Asserting(Lucene70): {shard_s=PostingsFormat(name=LuceneVarGapDocFreqInterval), _version_=PostingsFormat(name=Memory), id=PostingsFormat(name=Memory)}, docValues:{}, maxPointsInLeafNode=1028, maxMBSortInHeap=6.135627098877164, sim=RandomSimilarity(queryNorm=false): {}, locale=hu-HU, timezone=America/Barbados
[junit4] 2> NOTE: Mac OS X 10.11.6 x86_64/Oracle Corporation 1.8.0_131 (64-bit)/cpus=3,threads=1,free=148684368,total=413138944
[junit4] 2> NOTE: All tests run in this JVM: [TestReqParamsAPI, TestStressLucene, SOLR749Test, DirectSolrSpellCheckerTest, TolerantUpdateProcessorTest, CollectionStateFormat2Test, TestRandomRequestDistribution, PreAnalyzedUpdateProcessorTest, TestHalfAndHalfDocValues, MoveReplicaHDFSTest, TestLRUCache, TestRemoteStreaming, TestPostingsSolrHighlighter, SolrCmdDistributorTest, BasicFunctionalityTest, TestReplicaProperties, DistribDocExpirationUpdateProcessorTest, LukeRequestHandlerTest, SystemInfoHandlerTest, TestFastLRUCache, HighlighterMaxOffsetTest, TestSolrJ, JsonLoaderTest, TestUninvertingReader, TestCrossCoreJoin, TestSchemaVersionResource, TestCloudPseudoReturnFields, FieldMutatingUpdateProcessorTest, RecoveryAfterSoftCommitTest, TestStreamBody, SpatialRPTFieldTypeTest, TestMiniSolrCloudCluster, TestRequestStatusCollectionAPI, TestDistributedMissingSort, TestSolrDeletionPolicy1, TestBlobHandler, SpellingQueryConverterTest, MetricUtilsTest, IgnoreCommitOptimizeUpdateProcessorFactoryTest, TestTrie, TestJavabinTupleStreamParser, TestFiltering, TestNoOpRegenerator, TestDistributedStatsComponentCardinality, TestFastWriter, TestManagedSynonymFilterFactory, ConnectionManagerTest, ExternalFileFieldSortTest, TestManagedSchemaAPI, TestUniqueKeyFieldResource, HdfsChaosMonkeySafeLeaderTest, OpenExchangeRatesOrgProviderTest, TestReload, TestRecoveryHdfs, TestSuggestSpellingConverter, MigrateRouteKeyTest, TestConfig, TestManagedResourceStorage, ZkStateWriterTest, OverseerRolesTest, TestSegmentSorting, BasicZkTest, DebugComponentTest, DeleteReplicaTest, TestNonDefinedSimilarityFactory, TestDocTermOrds, SchemaVersionSpecificBehaviorTest, TestFieldCacheSortRandom, TestMergePolicyConfig, TestLuceneMatchVersion, SampleTest, CopyFieldTest, ZkNodePropsTest, HdfsDirectoryTest, DistributedIntervalFacetingTest, BaseCdcrDistributedZkTest, TestMacros, TestConfigSetsAPIZkFailure, TestComplexPhraseLeadingWildcard, SearchHandlerTest, TestHighFrequencyDictionaryFactory, TestShardHandlerFactory, TestUseDocValuesAsStored2, TestStandardQParsers, AtomicUpdatesTest, TestSchemalessBufferedUpdates, TestInfoStreamLogging, CollectionsAPIDistributedZkTest, TestRandomFaceting, LeaderElectionIntegrationTest, TestCopyFieldCollectionResource, ZkSolrClientTest, TestPKIAuthenticationPlugin, StatsComponentTest, ChangedSchemaMergeTest, ClassificationUpdateProcessorIntegrationTest, TestQueryTypes, ShufflingReplicaListTransformerTest, DateRangeFieldTest, DistanceUnitsTest, TestSmileRequest, ChaosMonkeySafeLeaderTest, TestExactStatsCache, OverseerCollectionConfigSetProcessorTest, CloneFieldUpdateProcessorFactoryTest, SignatureUpdateProcessorFactoryTest, BitVectorTest, SolrShardReporterTest, FileUtilsTest, OverseerTaskQueueTest, ExitableDirectoryReaderTest, TestAnalyzedSuggestions, TestSubQueryTransformerDistrib, TestJsonFacets, LargeFieldTest, TestConfigSetsAPI, DistributedSuggestComponentTest, TestFieldCacheWithThreads, TestCustomSort, SolrIndexConfigTest, TestFieldResource, DistributedMLTComponentTest, CollectionsAPIAsyncDistributedZkTest, TestPerFieldSimilarity, LoggingHandlerTest, DOMUtilTest, CustomCollectionTest]
[junit4] Completed [312/727 (2!)] on J1 in 52.10s, 4 tests, 1 error <<< FAILURES!
[...truncated 44806 lines...]